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f^i , Abstract 



, We study the relation between Donaldson-Thomas theory of Calabi-Yau threefolds and 

a six-dimensional topological Yang-Mills theory. Our main example is the topological U(N) 
gauge theory on flat space in its Coulomb branch. To evaluate its partition function we use 
equivariant localization techniques on its noncommutative deformation. As a result the gauge 
theory localizes on noncommutative instantons which can be classified in terms of TV-coloured 
three-dimensional Young diagrams. We give to these noncommutative instantons a geometrical 
description in terms of certain stable framed coherent sheaves on projective space by using a 
higher-dimensional generalization of the ADHM formalism. From this formalism we construct 
a topological matrix quantum mechanics which computes an index of BPS states and provides 
an alternative approach to the six-dimensional gauge theory. 
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1 Introduction 



Topological field and string theories that arise from a topological twist of a physical model 
capture the BPS sector of their physical counterparts. They have been used successfully in the 
last decades to compute certain classes of nonperturbative effects, thereby considerably improving 
our understanding of the quantum world. Topological theories also have a deep relation with 
mathematics as they relate BPS quantities to geometrical invariants of the underlying manifold. 
For example, topological string theory is equivalent to certain enumerative problems for Calabi- 
Yau threefolds and it computes invariants such as the Gopakumar-Vafa, Gromov-Witten and 
Donaldson-Thomas invariants. These invariants play a key role in the mirror symmetry conjecture 
which is by now one of the best understood examples of duality in string theory (see pQ for a 
review). On the other hand, these invariants enter directly in the computation of the entropy of 
a class of supersymmetric black holes that arises in string theory compactifications on a Calabi- 
Yau manifold via the Ooguri-Strominger-Vafa (OSV) conjecture and provide some computational 
control on the enumeration of quantum gravity microstates [2]. 

Donaldson-Thomas invariants count bound states of D0-D2 branes with a single D6-brane 
wrapping a Calabi-Yau threefold. The geometrical object that describes this configuration is called 
an ideal sheaf and the Donaldson-Thomas invariants can be roughly thought of as "volumes" of 
the moduli spaces of ideal sheaves. When the Calabi-Yau space is toric the topological string 
theory has a reformulation in terms of the classical statistical mechanics of a melting crystal [3]. 
In this setting the Donaldson-Thomas invariants enumerate atomic configurations in the melting 
process. Just like the Gopakumar-Vafa invariants, Donaldson-Thomas theory computes certain 
F-terms in the low energy effective action of the string theory compactification [lj-[6]. Indeed, 
it is conjectured that the Donaldson-Thomas invariants are equivalent to the Gopakumar-Vafa 
and Gromov-Witten invariants as they arise from different expansions of the same topological 
string amplitude. This conjecture is known to be true in the toric setting [7j. The melting crystal 
picture also has an interpretation as a sum over fluctuating Kahler geometries [8]. This sum can 
be explicitly rewritten as a path integral of an auxiliary six-dimensional topological gauge theory. 
This theory localizes on the moduli space of solutions of the Donaldson-Uhlenbeck-Yau equations 
which can be thought of as generalized higher-dimensional instantons. The proposal of |H] consists 
in identifying the instanton counting problem associated to this gauge theory with the Donaldson- 
Thomas enumeration of ideal sheaves. 

Accordingly, Donaldson-Thomas theory is reduced to six-dimensional instanton calculus. To 
this end one can adopt the approach envisaged by Nekrasov in the four-dimensional case and apply 
the techniques of equivariant localization in topological field theories [§]. Roughly, Nekrasov's 
formalism consists of a noncommutative deformation of the gauge theory that resolves certain 
singularities of the instanton moduli space and a particular redefinition of the BRST charge that 
localizes the instanton measure on pointlike configurations. The BRST charge is now an equivariant 
differential with respect to the natural toric action on the C 2 target space and as a result integration 
over the instanton collective coordinates is reduced to a sum over pointlike instantons via the 
equivariant localization formula. These ideas were applied to the six-dimensional gauge theory 
under consideration on a generic toric Calabi-Yau threefold in [8], with the main difference being 
the appearance of degenerate gauge field configurations which wrap rational curves. The gauge 
theory partition function can in this way be successfully matched with the melting crystal partition 
function. 

The full picture is thus consistent, and gives strong support to the equivalence between the 
six-dimensional gauge theory on the D6-brane and Donaldson-Thomas theory. Nevertheless, a 
direct link is still lacking. The equivalence becomes clear only after the gauge theory partition 
function is matched with the topological vertex amplitude. It would be desirable to have a direct 
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understanding of Donaldson-Thomas theory in the gauge theoretic picture and in particular to 
investigate the ideal sheaf counting problem in terms of the gauge theory variables. Moreover, 
the fact that we are now dealing with a gauge theory poses two pressing questions. Firstly, it is 
natural to consider a higher rank generalization of the problem which corresponds to introducing 
an arbitrary number N of D6-branes in the picture. While this is conceptually simple the relation 
(if any) with the usual topological string theory is rather obscure. We expect that a resolution 
of this puzzle may shed some new light on the black hole microstate counting problem. Secondly, 
topological string amplitudes have modular transformation properties that allows one to carry the 
information about the enumerative invariants along the various regions of the Calabi-Yau moduli 
space. In particular, knowledge of the Gromov-Witten invariants at the large radius point is 
enough to compute them, say, at orbifold points [10J. One may wonder how this property is seen 
in Donaldson-Thomas theory given that the gauge theory is naturally defined at the large radius 
point. 

The aim of this paper is to investigate in detail the aforementioned proposals and conjectures, 
and to make a first step towards the resolution of the outlined problems. In particular, we will 
explore the random partition combinatorics of the nonabelian theory and its formulation in terms 
of a topological vertex. Partial results in this direction were described in [llj . as well as in |12j . 
We work mainly on flat space in the Coulomb branch of a U(N) gauge theory. In this case we 
are able to set up a general formalism that we hope could be applied to more general settings. 
We attack the problem in two independent but intimately connected ways. As a start we define 
and evaluate the partition function of the noncommutative deformation of the gauge theory. The 
noncommutative gauge theory localizes onto a sum over critical points that are classified in terms 
of A-coloured three-dimensional Young diagrams. The fluctuation factor around each critical point 
has the form of a ratio of functional determinants that can be computed by direct evaluation. The 
result is a simple generalization of the MacMahon function which captures the counting of BPS 
states for a configuration of D6-branes widely separated in the transverse directions. 

We give a purely geometric interpretation of these noncommutative instantons. Under a certain 
set of plausible assumptions we can relate the noncommutative gauge field configurations with the 
stable framed moduli space of certain coherent sheaves on P 3 , a compactification of the target space 
C 3 . The main technical tool is the use of Beilinson's spectral sequence to parametrize a coherent 
sheaf on P 3 with a set of matrix equations. We show that a special class of such sheaves arise as the 
cohomology of certain nonlinear monads on P 3 . The matrix equations are naturally interpreted as 
a higher-dimensional generalization of the ADHM formalism. This construction provides a direct 
relationship between the gauge theory and Donaldson-Thomas theory, and should be compared 
to the recent construction by Diaconescu [13J for the local Donaldson-Thomas theory of curves in 
terms of ADHM quiver sheaves. 

From this generalized ADHM language we construct a topological matrix quantum mechanics 
that dynamically describes the stable coherent sheaves. In the string theory language this model 
corresponds to the effective action on the gas of DO-branes that are bound to the D6-branes (in 
the presence of a suitable -B-field) [H]-[l6]. Equivalently, we may think of the matrix model as 
arising from the quantization of the collective coordinates around each instanton solution. In either 
way the matrix model recovers the classification of the critical instanton configurations in terms of 
iV-coloured three-dimensional Young diagrams via the special properties of the linear maps in the 
generalized ADHM equations. The computation of the instanton fluctuation factors is reduced to 
the evaluation of an appropriate equivariant index associated with the topological matrix model. 
The results agree with the direct computation done in the original noncommutative gauge theory. 

As an application of our formalism we compute the partition function of the rank N gauge 
theory in the Coulomb branch on a generic toric Calabi-Yau manifold. The result is the iV-th 
power of the abelian partition function with an N dependent sign shift. This shift is consistent 
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with the expected shift in the topological string coupling constant when the amplitude is related 
to the D-brane charges at the attractor point of the BPS moduli space. In particular, our results 
should provide a testing ground for the OSV conjecture with many D6-branes. Although the gauge 
theory provides essentially the same Donaldson-Thomas invariants, the Gromov-Witten theory is 
new and involves an additional expansion parameter, the rank N of the gauge group. 

It is instructive to compare at the outset with the analogous problem in four dimensions. 
Since the six-dimensional gauge theory we consider is maximally supersymmetric, it is tempting to 
believe that its dynamics are qualitatively similar to the well-studied 3\T = 4 supersymmetric U (N) 
Yang-Mills theory in four dimensions which is a topological twist of the N = 2 Seiberg-Witten 
theory. In that case the partition function is independent of the vevs of the scalar fields, and hence 
of the gauge symmetry breaking pattern, because it always computes the Euler characteristic of 
the (compactified) instanton moduli space. More precisely, for the K = 2 Seiberg-Witten theory, 
which computes the low energy effective action, one can use holomorphy properties to argue that 
the prepotential is a generic solution [9], even when some of the Higgs field eigenvalues coincide. 
By using the equivalence between Donaldson- Witten theory and Seiberg-Witten theory [17j . this 
shows (modulo subtleties associated to wall-crossing phenomena) that it is enough to localize the 
gauge theory onto the Cartan subgroup, and indeed a direct computation of Donaldson-Witten 
invariants for SU(N) gauge group gives no newer information than the [/(l)^ -1 Seiberg-Witten 
theory computation. 

However, there is no reason to expect that the infrared dynamics of the six-dimensional gauge 
theory is similar. Moreover, at present it is not known what is the rigorous stability condition to 
place on higher-rank sheaves over three-dimensional Calabi-Yau manifolds in order to construct a 
well-behaved compactification of the moduli space. Due to our lack of understanding of this moduli 
space, there is no guarantee that the instanton configurations that we localize onto span the appro- 
priate moduli space of nonabelian gauge field configurations. For the gauge theory on C 3 we have 
good control over the instanton moduli space and an explicit construction (with the caveat that we 
have not rigorously defined the appropriate compactification of the instanton moduli space). We 
argue in the following that in this case the allowed sheaves are those provided by the noncommuta- 
tive deformation, and give an explicit algebro-geometric description including appropriate stability 
conditions. For more general toric threefolds, our computations merely provide a localization of 
the full nonabelian Donaldson-Thomas theory onto those sheaves which are invariant under the 
equivariant action of the maximal torus of the gauge group. For more general symmetry breaking, 
the sheaves should carry a nontrivial framing (as proposed in [13]) and the fixed point locus need 
not consist of isolated points. Usage of the localization formulas in this case would require the much 
more complicated integration over degenerate fixed point submanifolds of moduli space weighted 
by the Euler class. 

This paper is organized as follows. In Section 2 we review the geometrical setting of the 
six-dimensional gauge theory and its equivariant deformation. Section 3 is devoted to the non- 
commutative deformation of the gauge theory and the evaluation of the partition function on flat 
(noncommutative) space. Section 4 is devoted to geometrical aspects and contains the derivation 
of our ADHM-like formalism. This formalism is used in Section 5 to construct a topological matrix 
quantum mechanics that computes an index of BPS states. In Section 6 we compute the partition 
function of the rank N gauge theory in the Coulomb branch on a generic toric Calabi-Yau manifold. 
Section 7 contains some further discussion and applications of our results. 

2 Topological ~N T = 2 Yang-Mills theory in six dimensions 

In this section we will collect some known results concerning the six-dimensional gauge theory 
which captures the physics of the Kahler quantum foam. This theory has been studied in the 
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literature both as a cohomological field theory [18] and in the balanced formalism [19], i.e. with 
3MV = 2 topological charges. In order to keep the discussion completely general we will consider the 
U(N) gauge theory defined on a toric threefold, but for concrete applications we will often specify 
to an abelian U(l) or U(1) N theory on C 3 . Some of the results reviewed here are also valid in the 
more general context of a generic Kahler manifold. 

2.1 The cohomological gauge theory 

The gauge theory in question can be defined through a topological twist of the maximally super- 
symmetric Yang-Mills theory in six dimensions. One starts with N = 1 U(N) supersymmetric 
Yang-Mills theory in ten dimensions and dimensionally reduces on a six-dimensional Kahler mani- 
fold X with U(3) holonomy. After the twist the bosonic spectrum of the theory consists of a gauge 
field Ai, a complex Higgs field $ and (3, 0)-form p = p 3 ' along with their complex conjugates, all 
taking values in the adjoint representation of the U(N) gauge group. In the fermionic sector we 
can twist the spin bundle with the canonical line bundle over X and obtain explicitly an isomor- 
phism between fermions and differential forms [20]. The spectrum consists of a complex scalar 77, 
one- forms ift ' and ip ' , two-forms tp 2,0 and ip 0,2 , and finally three-forms V> 3 ' and V' ' 3 for a total 
of 16 degrees of freedom matching those of the bosonic sector. The resulting supersymmetric gauge 
theory is cohomological and has two topological charges. It can therefore be studied as a balanced 
topological field theory as in [21] . The bosonic part of the action has the form 

S = ±J Tr (d A $A*d A ¥+ [<$>^] 2 + \F 2 / + d\ P \ 2 + \FY\ 2 ) 

+ i J Tr (F A AF a Ak + %F A A F A A F4) , (2.1) 

where d A = d + i [A, — ] is the gauge-covariant derivative, * is the Hodge operator with respect to 
the Kahler metric of X, F A = dA + A A A is the gauge field strength, ko is the background Kahler 
two-form of X, and 1? is the six-dimensional theta-angle which will be identified later on with the 
topological string coupling g s . 

In [8] the U(l) gauge theory has been given a suggestive interpretation as a Kahler quantum 
foam. One starts with a path integral which represents a sum over Kahler geometries with quantized 
Kahler class k = ko + g s F A . Expanding the Kahler gravity action J x k A k A k and gauge fixing 
the residual symmetry gives precisely the Kt = 2 topological gauge theory. In this interpretation 
it is essential that the gauge field curvature F A is a representative of the Chern class of a complex 
line bundle over X. For higher rank gauge groups U(N), N > 1 a characterization of the gauge 
theory as a gravitational theory is not known. 

The gauge theory has a BRST symmetry and hence localizes onto the moduli space of solutions 
of the fixed point equations 

9 A P , 

I ko A ko A ko , 

. (2.2) 

The right-hand side of the second equation is a quantum correction coming from the magnetic 
charge of the gauge bundle, where I is a constant. The solutions of these equations minimize the 
action (|2.ip and we will therefore call them generalized instantons or just instantons. We will be 
interested in the set of minima where the field p is set to zero. This is always possible on a Calabi- 
Yau background, because of the uniqueness of the holomorphic three-form in that case. Then the 
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first two equations reduce to the Donaldson-Uhlenbeck-Yau (DUY) equations which are conditions 
of stability for holomorphic bundles over X with finite characteristic classes. 

We will generically denote an appropriate compactification of the moduli space of solutions to 
the first two equations of (12, 2p with M, or with M(iV, c\, cli2, CI13) labelling the solutions by their 
rank and Chern classes when we want to be more explicit about their topology, or by M(X) when 
we want to stress the role of the underlying variety X on which the gauge theory is defined. We will 
also include in M those configurations that solve (|2.2p where the gauge field is possibly singular on 
X. More precisely, we will not restrict attention to holomorphic bundles but in principle consider 
also coherent sheaves of Ox-modules over X of rank N. It is not clear that this compactification 
always exists for a generic threefold as very little is known about these moduli spaces, and we may 
expect the singular loci to be intractable. This lack of a geometrical understanding is a major 
obstacle in carrying out the localization program. We will see in the rest of this paper how some 
progress can be made in specific situations. 

2.2 Local geometry of the instanton moduli space 

The moduli space M is a highly singular and badly behaved complex variety. When N = 1 and 
c\ = this problem has been cured in [8], and with an appropriate compactification there is an 
isomorphism M(l, 0, cli2, CI13) = "Jk(X, (3) with the moduli space of ideal sheaves over X with fixed 
two-homology class (5 and holomorphic Euler characteristic k as defined for example in [7\. This 
moduli space is also isomorphic to the Hilbert scheme of points and curves in X, Hilb fc (X,/3). In 
the following we will keep the rank TV arbitrary as we can formally consider a nonabelian gauge 
theory. In principle one could try to formulate the Donaldson-Thomas theory as a localization 
problem for a gauge theory in arbitrary rank. However, one should face the difficult technical 
problem of integrating over the appropriately compactified moduli space. We can hope to make 
computational progress in the Coulomb phase of the gauge theory where the gauge symmetry is 
completely broken down to the maximal torus U(1) N by the Higgs field vacuum expectation values 
and the moduli space essentially reduces to N copies of the Hilbert scheme where localization 
techniques can and have been successfully applied. A precise geometric characterization of M is 
not known and lies beyond the scope of this paper. In particular, integration over M is ill-defined 
and requires appropriate homological tools to be dealt with. For our practical purposes we will 
ignore these (important) issues and base our analysis on gauge theory techniques. It will be enough 
to know that for N = 1 a perfect obstruction theory can be developed and a virtual fundamental 
class of M has been defined [25]. In Section H] we will explore a sheaf theoretical description of the 
moduli space M for N > 1 in the case X = C 3 . 

From the gauge theory perspective we are dealing with holomorphic bundles and pairs (A,p). 
The first step in understanding the moduli space M is to characterize its local geometry. For this, 
we introduce the instanton deformation complex [8j 

^n°'°(X,adg)-^ n ' 1 {X,adQ)®n°' 3 (X,a,dg)^^n°' 2 {X,adg) ^0 , (2.3) 

where Q m ''(X, ad q) denotes the bicomplex of complex differential forms taking values in the adjoint 
gauge bundle over X, and the maps C and Da represent a linearized complexified gauge trans- 
formation and the linearization of the first equation in (|2.2p respectively. A precise definition can 
be found in [5] [23] . This complex is elliptic and its first cohomology represents the holomorphic 
tangent space to M at a point (A,p), Tm ^DVC. The degree zero cohomology represents reducible 
pairs (A,p), whereby the gauge field A is a reducible connection which we assume vanishes. 

On the other hand, in general there is also a finite-dimensional second cohomology that measures 
obstructions and is customarily called the obstruction or normal bundle N. It is associated with 
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the kernel of the conjugate operator D\. Since this is the operator that enters in the kinetic term 
for the antighost fields, the terminology "antighost bundle" is used for N in the physics literature 
as its fibres are spanned by the antighost zero modes. It is precisely this bundle which provides 
an "integration measure" on the moduli space. On general grounds the fermionic BRST symmetry 
localizes the partition function of the topological gauge theory onto the moduli space M (once a 
topological sector is chosen by fixing a critical point). There are nevertheless remaining fermionic 
terms to be integrated over. In particular, there is a four-fermion interaction schematically of 
the form 31 ip ip ip where ip collectively denotes the Fermi fields. A careful analysis of the BRST 
transformations and of the on-shell action shows that this term produces an integral representative 
of the Euler characteristic of the antighost bundle over the moduli space [HI 121 j . Equivalently, 
matching the Fermi zero modes with the fermionic path integral measure brings down the pfaffian 
of the curvature 51. 

As the detailed analysis is quite involved, we will just denote this integral symbolically as 



It is difficult to give a precise definition of this integral and to evaluate it. For this one needs 
rather sophisticated tools such as a perfect obstruction theory and to deal with the relevant virtual 
fundamental class of M. Throughout this paper we will assume the existence of a perfect obstruction 
theory and a corresponding virtual cycle. Then the localization formulas of Section 12.31 below will 
be used to define the integrals (|2.4p . A special case where we can make extensive computational 
progress in the evaluation of (|2.4|) is when the ambient variety is X = C 3 . Since (3 is necessarily 
trivial in this case (equivalently cli2 = 0), the relevant moduli space for N = 1 can be identified 
with the Hilbert scheme Hilb fc (C 3 ) = (C 3 )[ fc l consisting of zero-dimensional subschemes in C 3 . For 
k > 3 this moduli space generically contains branches of varying dimension and so is not even a 
manifold. 

2.3 The equivariant model 

If the moduli space M were smooth and compact, then we could proceed to evaluate the integrals 
(|2.4p by choosing an appropriate representative of the cohomology class e(3M"). However, this is not 
the case as moduli spaces of instantons suffer from non-compactness problems arising both from 
singularities where instantons shrink to zero size as well from the non-compactness of the ambient 
space X on which the gauge theory is defined. In field theoretical terms, we can think of diver- 
gences coming from the first problem as associated with small distances while the second problem 
reflects the need for an infrared regularization. The ultraviolet behaviour improves substantially by 
introducing a noncommutative deformation of the gauge theory that provides a natural compacti- 
fication of the instanton moduli space. We will define and study the deformed instanton calculus 
in the ensuing sections, but for the time being we will assume that this problem has been solved. 

A direct evaluation of the integrals (12. 4D is still a formidable problem. A particularly powerful 
approach is to use equivariant localization. In our problem we will assume that the gauge theory 
is defined on a toric threefold X. It carries the action of a non-compact three-torus T 3 , and we 
further assume that this action lifts to the moduli space M. Working T 3 -equivariantly means that 
we restrict our attention to critical gauge field configurations that are T 3 -invariant. A practical way 
to implement this scheme is to modify the gauge theory so that the BRST differential on the space 
of fields becomes an equivariant differential, so that an infinitesimal T 3 rotation can be undone by 
a gauge transformation. 

When X = C 3 , a physical realization of the equivariant modification with respect to the toric 
isometry is to put the gauge theory on the "O-background" . For the present gauge theory this 





7 



procedure was developed in [8j. If we think of our cohomological gauge theory as arising from a 
topological twist of maximally super symmetric Yang-Mills theory in six dimensions, then working 
equivariantly is equivalent to replacing the original scalar BRST operator Q used for the twist with 
a linear combination of the scalar and vector supercharges Q l given by 

Qn = Q + eaW ij x i Qi . (2.5) 

Here e a , a = 1, 2, 3 are formal parameters of the T 3 action and Q a — ^ij ^ ~Bx~ vector fields 
which generate the SO(6) rotational isometries of M 6 = C 3 . We will restrict to the U(3) holonomy 
subgroup that preserves the natural, translationally- invariant Kahler two- form of C 3 . Then the toric 
symmetry group T 3 is the maximal torus of this U (3). The result is a topological deformation of the 
gauge theory, augmenting the action by a Qn-ex&ct term, which depends explicitly on the vector 
fields £l a . Since the BRST charge Qn is a linear combination of supercharges, perturbative bosonic 
and fermionic contributions cancel, and the partition function is saturated by instantons. The key 
point here is that, in the Coulomb phase, the f2-deformation localizes the instanton measure onto 
point-like instanton configurations which are invariant under T 3 rotations. The critical points of the 
deformed gauge theory action are thus isolated. Due to localization, the semiclassical approximation 
is exact and the full path integral reduces to a sum over contributions from isolated point-like 
instantons. 

This deformation turns the evaluation of the integrals (|2.4p into a problem that is both well- 
defined and computationally accessible by equivariant localization techniques. In addition, the O- 
background acts as an infrared regularization and the equivariant volumes of the instanton moduli 
spaces are finite. In the gauge theory action (|2.ip the ^-background modifies, among other things, 
the kinetic term for the Higgs field to 

Tr (d A <I> - taF A ) A * (cU$ - i^Fa) (2.6) 

where iq is contraction with the vector field that generates the toric isometries. This modifies the 
third equation of (12. 2D to 

d A $ = mF A , (2.7) 

which manifestly minimizes the action on the ^-background. The Higgs potential and the fermionic 
terms are also affected by the fi-background, but we will not need their precise forms. 

The discussion of Section 12.21 above can be carried out in an equivariant setting with minor 
modifications and the suitable version of the integral (|2.4p can be now evaluated with equivariant 
localization techniques. This will be done explicitly in the following sections for the Coulomb phase 
of the gauge theory. For the moment let us just sketch the idea behind the procedure, glossing 
over many details. In the equivariant model on X = C 3 with the natural T 3 action, the Euler class 
e(N) is an element of the U(N) x T 3 equivariant cohomology of the moduli space M, where the 
gauge group U(N) acts by rotating the trivialization of the instanton gauge bundle at infinity in 
C 3 . Its equivariant integral ^ e(N) is the localization of the pushforward of e(N) G ^mjv)xp(^) 
in ^(jv) xT 3(pt) = C [Sym Ar (C); e ffl ] under the collapsing map M — > pt onto a point, where the 

symmetric product Sym Ar (C) = C n /Sn parametrizes the complex conjugacy classes of U(N). 
These classes can be labelled by elements a = (a\, . . . , oat) of the Cartan subalgebra u(l)® w = R . 
Denoting £ = (o, e ), there is a moment map 

^}=^u(N)[a}+^[ea] : M — (u(l)® iV )*eLie(T 3 )* (2.8) 

and an invariant symplectic two-form wonM such that the U (N) x T 3 action on M is hamiltonian, 

d//[£] = -i Vi u , (2.9) 
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where V£ is the vector field on M representing the toric action generated by £. 

Using (|2,9p we can represent e(N) by a cohomologically equivalent equivariant differential form, 
and hence replace <f M e(N) by an ordinary integral over the moduli space, J M e(N) A exp(u; + //[£])• 
We may then appeal to the Duistermaat-Heckman localization formula 



where n = dime M and the sum on the right-hand side runs over the fixed points of the toric action. 
The parameters Wi[£] are the weights of the toric action on the tangent space to the critical points 
on M. The Duistermaat-Heckman theorem assumes that the toric action on the ambient space X 
lifts to the moduli space and that its critical points are isolated. This is precisely what happens 
in the case where the gauge theory is defined on the Q-background. One just needs to evaluate 
the integrand at each critical point and sum over all critical points with the appropriate weights. 
Thus in practice the evaluation of (|2.4|) in the equivariant model simply relies on being able to 
exhibit a complete classification of the critical points of the toric action. This will be explored in 
the following sections. 

The assumptions made above on the instanton moduli space are not generally satisfied. To 
deal with such situations there is a powerful generalization of the Duistermaat-Heckman formula, 
the Atiyah-Bott localization formula for virtual classes. This formalism can be applied in the case 
at hand, and has been done in [7] for rank one sheaves. In the gauge theory setting, however, it 
is easier to deal with the equivariant localization as if the Duistermaat-Heckman formula and its 
supersymmetric generalizations were still reliable. In fact, the general story is a bit more involved 
than what we have been discussing thus far. When dealing with gauge theory on a toric manifold 
one must deal with the localization procedure more carefully. Now the T 3 -invariant configurations 
are not necessarily point-like and the partition function localizes into a sum of contributions coming 
from the points and curves which are fixed by the toric action. Each of these contributions can be 
expressed as an integral over the instanton moduli space, or more precisely over one of its connected 
components. Then one can deal with the integrals over the component moduli spaces as outlined 
above. 

In [8] the cohomological gauge theory on a toric threefold X was expressed as a sum over 
contributions coming from the vertices of the underlying toric graph A(X), which correspond to 
point-like generalized instantons with action J x Tr Fa A Fa A -Fa. These contributions are connected 
by gauge field configurations fibred over the rational curves which connect the fixed points in the 
toric diagram, with action J x Tr ko A Fa A Fa- This procedure can be summarized as a set of 
gluing rules which are completely analogous to those of the melting crystal reformulation of the 
topological A-model string theory, whereby the framing conditions to be imposed when matching 
the contributions from two different vertices of the crystal get mapped into a set of asymptotic 
boundary conditions for the gauge field configurations, or equivalently a framing of the generalized 
instanton gauge bundle at infinity. 

3 Noncommutative gauge theory 

In this section we will consider another deformation of the six-dimensional maximally super- 
symmetric gauge theory which simplifies explicit computations. This deformation resolves the 
small instanton singularities of the moduli space M and enables explicit construction of instanton 
solutions. Moreover it provides a compactification of the instanton moduli space that is very nat- 
ural from a gauge theoretical perspective. Its geometric interpretation will be elucidated in the 




(2.10) 



v 4 (/)=o i=l 
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next section. For the time being we consider the U(N) gauge theory defined on X = C 3 = M 6 , 
and deform it on the noncommutative space Rn. This is equivalent to regarding the gauge theory 
as an infinite-dimensional matrix model where the fields are replaced by operators acting on a 
separable Hilbert space [24J-[26j. In this case there is a single patch in the geometry and only 
six-dimensional point-like instantons contribute to the partition function. In particular, there is no 
contribution from four-dimensional instantons stretched over rational curves P , which are absent 
in this geometry. As the detailed calculations in the following are somewhat technical, let us start 
by summarizing the main results of this section. 



3. 1 Statement of results 

We localize the noncommutative gauge theory with respect to the equivariant action of the abelian 
group T 3 x U(l) on C 3 . The resulting instanton expansion of the partition function is a generating 
function for Donaldson-Thomas invariants given by 

Z^ 1)JV (C 3 )=^(-l)( 7V+1 )l Tf l^l (3.1) 

7? 

where q = — e 11? = e~ 9s . The sum runs through iV-coloured, three-dimensional random partitions 
tt = (ir%, . . . , ttn) with |7r| = |7Ti| + • • • + \^n\ boxes. The set of components 717 of fixed size k\ = \iti\ 
is in correspondence with the Hilbert scheme Hilb fc '(C 3 ) of ki points in C 3 , which consists of ideals 
of codimension ki in the polynomial ring C[z , z 2 , z 3 ]. The generating function ()3.ip is a sum over 
torus invariant configurations of U(N) noncommutative instantons, which in the equivariant model 
consists of contributions from k = \ jf\ instantons on top of each other at the origin. In the abelian 
case N = 1 one recovers the anticipated MacMahon function 

00 

m ^ = n w—^ ' (3 - 2) 

n=l V " / 

the generating series for ordinary three-dimensional partitions. Whenever N is odd, the sign is 
independent of the partitions and the partition function closely resembles the abelian result. On 
the other hand, when ./V is even the partition function counts invariants with an alternating sign. 
In Sections H] and [5] we will connect this result to the counting of torsion- free sheaves on C 3 , while 
some physical applications will be described in Section [71 



3.2 Noncommutative instantons 



The coordinates x l of R^j satisfy the Heisenberg algebra 

[x* , x>] = ift , i,j = l,...,6, 



(3.3) 



where 9 = (O 13 ) is a constant real antisymmetric 6x6 matrix which we assume is nondegenerate. 
Using an SO(6) rotation, we can choose coordinates such that 9 assumes its Jordan canonical form 



/ 0! 

-01 



e 2 
-9 2 



\ 



e 3 
-9 3 / 



(3.4) 
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The algebra of "functions" on M.g will be denoted A. 

The instanton equations on the noncommutative background can be simplified by introducing 
the covariant coordinates 

X i = x l + i6 ij Aj , (3.5) 

and their complex combinations 

Z i = -±= (X 2t - 1 + i X 2i ) for i = 1, 2, 3 . (3.6) 

Using the Heisenberg commutation relations (|3,3p to represent derivatives as inner derivations of 
the algebra A, the instanton equations (12. 2D can then be rewritten in the form 



LTVxTV 



[z i ,z*]+& k [zl,p] = 0, 

[Z\zt\ + [p,J] = 3 1; 

[Z* , $] = (3.7) 

where i, j, = 1, 2, 3. The combination of the noncommutative deformation with the O-background 
parametrized by ej, i = 1,2,3 changes the last equation in (|3.7p to 

[Z* , $] = a Z i (no sum on i) . (3.8) 

For the remainder of this paper we will always set the (3, 0)-form field p to zero, as we work on a 
Calabi-Yau geometry. Then T 3 -invariance of the (unique) holomorphic three-form constrains the 
equivariant parameters of the O-background by the equation 

ei + e 2 + e 3 = . (3.9) 

These sets of equations can be solved by three-dimensional harmonic oscillator algebra. Defining 
an = —7= (x 2l_1 + \x 2t ), the commutation relations (|3.3p are equivalent to 

[cti,aj] = and [c^ , atj = 5ij . (3.10) 
The unique irreducible representation of this algebra is provided by the Fock module 

K = C[a\, a\, 4] |0, 0,0) = CK n 2 ,n 3 ) , (3.11) 

where |0, 0,0) is the Fock vacuum with «i|0, 0,0) = for i = 1,2,3, and the orthonormal basis 
states 712,713) are connected by the action of the creation and annihilation operators subject 
to the commutation relations (|3.10p . The operators (|3.6p may then be taken to act on the Hilbert 
space 

3i w = W®0i (3.12) 

where W = C N is a Chan-Paton multiplicity space of dimension N, the number of D6-branes (and 
the rank of the gauge theory). The space W carries the nonabelian degrees of freedom and we 
understand Z l and <I> as N x N matrices of operators acting on 'K, i.e. as elements of the algebra 
M|\r X jv(C)(8>.A. In the supersymmetric matrix model where the matrices are operators acting on the 
Hilbert space (|3.12|) . we only need to focus on the operators Z l , $ and their hermitean conjugates 
since we are interested in the class of minima where all other fields, including the twisted fermions, 
are set to zero. For example, the vacuum solution with Fa = is given by 

Z % = ati InxN , 
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$ = ^ tj a\ Qij InxN ■ (3.13) 
i=i 

For £7(1) gauge theory, other solutions are found with the solution generating technique, de- 
scribed for example in |27l 128] . Fix an integer n > 1 and consider a partial isometry U n which 
projects all states \i,j, k) with i + j + k < n out of the Fock space Ji. It obeys 

C/t JJ n = 1 - n n and I7 n L# = 1 (3.14) 

where II n is the projector 

n„= \h3,k){i,j,k\ . (3.15) 

j+j'+fc<n 

We may then build a solution from the vacuum (|3.13p of the form 

Z' = U n a t f(N)Ul, 

3 

eialo»c4 ' ( 3 - 16 ) 

i=i 

where / is a real function of the total number operator 

3 



x = 4 a i ■ ( 3 - 17 ) 



i=i 



The function /(N) is found by substituting this ansatz into the instanton equations to generate 
a recursion relation. With the initial condition /(0) = /(l) = • • • = /(re — 1) = and the finite 
action condition f(r) — > 1 as r — > oo, one then finds the solution 



The topological charge of the noncommutative U(l) instantons defined by 

k :=ch 3 = -i0iO 2 9 3 TtkF a AF a AF a = ± n (re + 1) (n + 2) (3.19) 

is the number of states in !H with N < re, i.e., the number of states removed by the operator U n , 
or equivalently the rank of the projector (I3.15|) . 



3.3 Nonabelian solutions 

We will now make some comments on how to generalize the U(l) solutions described above to 
generic U(N) gauge group. One can start, for example, from the noncommutative u(3)-valued in- 
stanton gauge field configuration constructed in , which is a smooth deformation of the canonical 
connection on the Stiefel bundle over P 3 , written in local coordinates on a patch C 3 of the projective 
space P 3 . To describe this solution, we set all 9i := 6, i = 1,2,3 for simplicity, and consider the 
exterior derivative d as a vector space morphism d : A — ► where the sheaf of one-forms 
over A is the bimodule A® e . Introduce elements 

^ = y/Wk (da { - 29 a* (7 2 + 7 Vl + 36* ) _1 at da J ) 7" 1 (3.20) 
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of tt A for i = 1, 2, 3, where 7 : IK — > IK is the invertible operator 

7 = >j29Ji + 1 + 36> . (3.21) 

From these operators one can construct a gauge field regarded as a morphism of .A-modules 

Fa : !Hw — ► Kw ®A &a > (3.22) 

where "Kw is the module Wq <g> IK with Wo = C 3 the fibre space of the Stiefel bundle, and the sheaf 
of two-forms over A is the bimodule Q 2 A = A® 15 . It is given by the 3x3 matrix of Fock space 
operators 

F A = (iPi A Vj) (3.23) 
which, in the basis of Q A generated by (|3.2U|) . has components 

F 2 / = and (F^).. = eij (3.24) 

where are the standard 3x3 matrix units. The corresponding covariant coordinates Zq thus 
obey the commutation relations 

[4 , Z>] = and [Zo ti , Zlj[ = 3e i3 , (3.25) 

and consequently they solve the noncommutative DUY equations in (|3.7p for U(3) gauge group 
with instanton charge k. See [29J for the detailed expressions for the covariant coordinates Zq. 

The desired N x N covariant coordinates Z l may be realized in terms of the U{3) solution 
Zq above by appealing to the Hilbert hotel argument, following [30]. For this, we introduce a 
lexicographic ordering Nq ~ No on the Fock space K so that |ni, 712,7x3) = \q) with q E No, and fix 
an orthonormal basis p a , a = 0, 1, 2 of the fibre space Wq. Then p a (8) \q) is an orthonormal basis 
for 'Kwo ari( i there is a one-to-one correspondence p a (8> \q) *-* \3q + a) of basis states. Similarly, 
by fixing an orthonormal basis A a , a = 0, 1, . . . , N — 1 of the U(N) representation space W = C^, 
there is a one-to-one correspondence A a <S> \q) <-> \N q + a) for the corresponding orthonormal basis 
of l K\y. Let us now introduce the rectangular N x 3 unitary isomorphism U : Kw — > "Kw by the 
formula 

2 JV-l 00 2 N-l 00 

C/ = E E E \Nr + b)(3q + a\ = J2 E E hpJ®\b)(a\. (3.26) 

a=0 fe=0 g,r=0 a=0 b=0 g,r=0 

3<j+a=A r r+6 3g+a=Afr+fe 



Starting from the C7(3) solution of the noncommutative gauge theory above, one then constructs 
the U(N) solutions 

Z i = U Z l U j . (3.27) 

Of course, these nonabelian solutions only constitute a subset of the full BPS solution space. More 
general solutions will contain appropriate versions of the function f(N) which featured into the 
solution of the noncommutative DUY equations when N = 1, and which reflect extra free moduli 
such as the size and relative orientation of the DO-branes on top of each other at the origin of 
X = C 3 (as exhibited explicitly in [27] for the four-dimensional case). However, in the following we 
will not need the details of this solution. We will only need to know that, even in the nonabelian 
case, the solution is parametrized by specific partial isometry operators as in Section 13.21 above. 
Some further aspects of the generic U(N) noncommutative instantons in six dimensions will be 
described in the next section. 
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3.4 Three- dimensional coloured partitions 



A key feature of the solution of the six-dimensional cohomological gauge theory will be its inter- 
pretation as a statistical theory of three-dimensional random partitions. To see random partitions 
emerging, let us diagonalize the field using the U(N) gauge symmetry to get 



V 



$0 



\ 



(3.28) 



This transformation induces a Vandermonde determinant det(ad<3?) in the path integral measure 
(|3.39p below. One can now classify the fixed points of the nonabelian gauge theory by generalizing 
the arguments of [El [31]. We are prescribed to compute the path integral over configurations of the 
Higgs field whose asymptotic limit is a = diag(ai, . . . , a^) S u(l) eAr . With this choice of boundary 
condition the noncommutative field has the form 



3> = a <g) ljc + l NxN g> $:k (3.29) 

on (|3.12p . up to a function that goes to zero at infinity faster that any power of x l . Note that this 
boundary condition only holds on X = C 3 . Nontrivial geometries require a more involved gluing 
together of different C 3 patches, as we discuss in Section EJ The degeneracies of the asymptotic 
Higgs vevs breaks the gauge group U(N) — ► U(ki) with 

h = N . (3.30) 

I 

Correspondingly, the Chan-Paton multiplicity space W decomposes into irreducible representations 
W = ®; Wi with dime W x = fcj. 

With our choice of the equivariant action of T 3 x U(1) N , the gauge theory will localize onto 
the maximal torus. Consequently the Higgs vevs ai may all be assumed distinct and the vacuum is 
the one with maximal symmetry breaking ki = 1 for I = 1, . . . , N. This means that the full Hilbert 
space ()3.12p splits into a sum of N "abelian" Hilbert spaces 5£, each one "coloured" by the Higgs 
vev a/. The theory localizes on noncommutative U(l) instantons that are in correspondence with 
maps of the full Hilbert space onto the subspace 

N 

^3 = \ [4 , 4 , 4] 10, 0, 0) , (3.31) 
1=1 

where J ai are ideals in the polynomial ring Cfz 1 , z 2 , z 3 ]. Each partial isometry U n satisfying (|3.14|) 
identifies the Fock space (13.111) with a subspace of the form in (13.311) . with d the ideal of codimension 
k consisting of polynomials / G Cfz 1 , z 2 , z 3 ] for which 

U n - f(a{,al,al)\0,0,0) = . (3.32) 

These ideals are generated by monomials z % z J z k and are in one-to-one correspondence with three- 
dimensional partitions. Thus in complete analogy with the four-dimensional case [9[ I31|, 152]. the 
solutions correspond to three-dimensional (plane) partitions with the triples (i,j,k) in (|3.15p cor- 
responding to boxes of the partition. More precisely, the solution can be found in terms of coloured 
partitions 

7? = (7T1, . . . ,7Tjv) , (3.33) 
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which are rows of N ordinary three-dimensional partitions 717 labelled by a/. We will explain this 
correspondence in more detail in Section [5j 

A specific class of observables of the gauge theory is given by the trace of powers of the Higgs 
field <£. Since the gauge theory is cohomological all the interesting observables (including the 
integral of the Chern character over C 3 ) can be expressed through these quantities by means of 
descendent relations. In particular, for the solution associated to the sum of ideals J = J ai ©• • -®0 aN 
corresponding to the three-dimensional coloured partition (|3.33|) . this produces the normalized 
character 

X3(t) = (l-e iei )(l-e^)(l-e^) T r^ e** (3.34) 



N 

^2 e ta ' (l - (1 - e* ei ) (1 - e* e2 ) (l - e^ 3 ) £ 

1=1 {i,j,k)eni 



e t(6i(i-l)+e 3 (j-l)+e3 (fc-1)) 



This construction has a heuristic interpretation in terms of D-branes. Localizing the gauge the- 
ory onto the Cartan subalgebra is equivalent to displacing the N D6-branes in the four-dimensional 
extended space outside the Calabi-Yau manifold X. The vevs of the Higgs field correspond to the 
positions of neighbouring D-branes relative to one another. This means that there are N separated 
D6-branes, each one with its own bound state of DO-branes corresponding to a six-dimensional 
instanton through anomalous couplings to Ramond-Ramond fields on the D6-brane worldvolume. 
The DO-branes are indexed by the boxes of the three-dimensional partition 717 and the "colour" 
of the partition is the information relative to which D6-brane they are bound to. ki DO-branes 
bound to a D6-brane labelled by 0/ are described by a three-dimensional partition with k\ boxes 
in the Z-th sector of the Hilbert space and correspond to a charge ki instanton on the worldvolume 
of the D6-brane in position a/. It should be stressed though that this geometric interpretation is 
somewhat naive and if the instanton measure has a nontrivial dependence on the Higgs vevs ai, 
then this could reflect open string degrees of freedom stretching between different D6-branes. 



3.5 Instanton weight 

We will now examine the noncommutative instanton contributions to the partition function of the 
U (N) topological gauge theory on C 3 in the vacuum of maximal symmetry breaking. Proceeding 
with localization the contribution of an instanton associated to a collection of ideals J comes with 
the weight factor 

6XP ( " 4^ Tr *b FA A F A A F A ) = exp (-^-) , (3.35) 

where Xy 1S the coefficient of t 3 in the power series expansion of the character (13.340 about t = 0. 
Using (|3.9p one finds 

N 3 

xS 3) = E(-y + ^ 3 E !)• ( 3 - 36 ) 

1=1 (i,j,k)£TTl 

The first term is independent of the partitions 717 and can be dropped as a universal perturbative 
contribution. The second term yields, for each I, the total number of boxes k\ = \k\\ in the partition 
717, which coincides with the topological charges (|3.19p of the corresponding noncommutative U(l) 
instantons. Thus for the weight of an instanton we obtain 

e itf 1*l (3.37) 
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in the sector of instanton charge 

N 

k = \jr\ = Y^ N (3-38) 
1=1 

given by the total number of boxes in the coloured partition. 
3.6 Instanton measure 

In addition to the weight there is also a contribution from the determinants representing quantum 
fluctuations around the instanton solutions. In the noncommutative gauge theory the ratio of 
fluctuation determinants is represented by [8] 

det (ad $) det (ad $ + e x + eg) det (ad $ + ei + eg) det (ad $ + e 2 + £3) ,„ „ q >. 

det (ad $ + ei + e 2 + e 3 ) det (ad $ + ei) det (ad $ + e 2 ) det (ad $ + e 3 ) 

where $ is in general nonabelian and given by (|3.29p . The origin of this ratio will be explained in 
more detail in Section [5j In the following we will compute the instanton measure explicitly. The 
ratio of determinants can be written as 

exp ( - I Tr ^ e** Tr^ e~** (l - e**) (l - e te ») (l - e*«»)) (3.40) 

which can be recast as an index-like quantity 

7 V; \ Jo t (1 - e t£ i) (1 - e*«) (1 - e***)/ v 7 

where 7? is the coloured partition corresponding to the given BPS state. 

First, we review the abelian case N = 1 in some detail. Let us break up the integral I u ^(tt) 
in (|3.4ip into three contributions I u ^ (it) = I^p + I± (vr) + 1% (it) given by 



jU{l) 



00 



dt 1 







t (l - e (£ i) (1 - e te *) (l - e* £ 3) 



CO 



jf (1) (7r) = ^ J" y (-e* ( e i*+ e ^+ e 3 *)+ e-*( e i*+ e »i-Na fc )) , (3.42) 







(j,J,fc)£7T 



x e 1 — e 



The integral Jvac is the universal vacuum contribution from the empty partition and will be 
dropped in the following. Evaluating the remaining integrals we obtain 

J^V) = sgn(e 1 i + e 2 j + e 3 k) , (3.43) 



ij (1) (7r) = ivr ]T (sgn(e 1 (i-i / + l)+e 2 (i-i / )+e 3 (A ; -A : / )) 

+ sgn( £l (t - »' ) + e 2 (j - j' + 1) + e 3 (k - k' )) 



(i',j',k' )eir 



16 



+ sgn(ei (i - i') + e 2 (j - / ) + e 3 (A; — A;' + F 

Since we are interested only in the exponentials of these integrals, the value ± 1 of the signum 
function is irrelevant (we count e ±17r = —1). Thus we have 



/^ (1) W _ (_-Q3|7r| 2 -diag ^ (3.44) 



C 



where diag denotes the "diagonal" terms for which the signum functions combine to give zero and 
have to be subtracted since they give a factor +1 instead of —1. The direct counting of how many 
diagonal terms are present for a given partition i is a bit complicated, and moreover one has to 
take into account the constraint (|3.9p . Instead, we will use induction to prove the result 

T U(1), n tU(1), n i I 

e -W)-W) = (_i)M (3.45) 

for any three-dimensional partition tt. 

Consider first the partition tt = (1,1,1) consisting of a single box, so that |7r| = 1. In this 

,17(1) J UI ^( \ —^Wf \ r^ 1 )/ \ 

case one has e 1 (it) = 1, e 2 w = —1 and e 1 (7V > 2 ' 7r ' = —1, so this partition satisfies 
(|3.45p . Suppose now that for some partition tt, eq. (13.450 is true. In the induction step we increase 
the number of boxes in this partition by one (in such a way that we still obtain a valid partition). 
Denote the new partition with the extra box at a given position (a, b, c) by tt* . One has | vr* | — | vr | = 1, 
and so we have to prove that 

e -h (*■ )~h )+h M+h W = _i . (3.46) 

For the first integral we have 

jp) (tt* ) _ j^ 1 ) (vr) = i vr sgn ( ei a + e 2 b + e 3 c) . (3.47) 

For the second integral, after some algebra we obtain 
T U(1), *n t U{1), s 

= 6|7r| + 3 — min(a, b — 1, c — 1) — min(a — 1, b, c) — min(a — 1, b, c — 1) 

— min(a, b — 1, c) — min(a — 1, b — 1, c) — min(a, b, c — 1) . (3.48) 

From these results it is easy to establish (j3.46|) . proving the induction step. 
Putting everything together, the abelian instanton measure is given by 

Z^ 1 \tt) = zV£) (-l)H . (3.49) 

Dropping the perturbative vacuum contribution and combining this result with the weight (|3.37p . 
the full instanton contribution to the U{\) partition function is given by 

* 1) (c 3 ) = E(- ei ") w = M ^)- ( 3 - 5 °) 

This is the known Donaldson-Thomas partition function on C 3 . 

This construction can be easily generalized to the case where the full nonabelian gauge sym- 
metry is broken to U(1) N . Using the character (I3.34p . the exponent (jf) of the fluctuation 
determinant (|3,4ip can again be written as the sum of three integrals 

T U(1) N _ f°° dt 1 A t( ai -a n ) /9Ki\ 

Jo t (l- e **)(l-e'«)(l-e*«) ^ ' 1 j 
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(vf) 



dt 



N 



e t(ai-a n ) 



Ln=l 



^_ ^ e t(eii+e2j+e 3 k) + ^ g -t (ei i+e 2 J+ea fc)^ 



(Tf) 



df 



N 

E 

Z,n=l 



,t (aj-a n ) 



E 



, i (ei (i-i' )+e 2 (j-j' )+e 3 (fc-fc' ) 



(jj',fc)e7r ; 
(i',i',fe')67r„ 

x (e iei - e~* ei + e* €2 - e~ t€2 + e* £3 - e" i€3 ) 



where as before 7r n , 717 denote components of the coloured partition (|3.33p and a n , ai are components 
of the classical value of the Higgs field (|3.28|) . Evaluating the integrals, the non-trivial contributions 
can be written as 



h (TTjdiag 



N 



i 7T ^ ^2 S S n ( £ l i + C 2 3 + e 3 fc) , 

z=i (i,i,fc)e7r; 



(^joflfdiag 



i vr ^ ^ sgn(ei i + e 2 j + e 3 A: + a in ) 



i,n=l (i,j,k)£iri 
N 



diag 



1 7T 



^ 2 (sgn(6 1 (i-z / + l) + e 2 (j-i / ) + e 3 (A : -A : / )) 



(i',i',fc')6*7 



+ sgn(ei (* - t' ) + e 2 (j - f + 1) + e 3 (A - k' )) 
+ sgn(ei (i-i') + e 2 (j + e 3 (k — k' + 1) 



h l^Joffdiag 



N 



1 7T 



J3 Yj (sgn(ei(f-i' + l)+e 2 (j - / ) + e 3 (A; - A/ ) + a In ) 



i,n=l (i,j,fc)e7r; 
«<™ (i',f,k')eTTn 

+ sgn(ei (i - ? 
+ sgn(ei (i - ? 

— sgn(ei (« — i 

— sgnfei (i — i 



+ £2 (j ~ f + 1) + e 3 (k - k! ) + a /n 
+ £2 (j - j' ) + e 3 (k - k' + 1) + a in 

-l)+€ 2 (j-j")+£3 (fc-A/J+Ofa 

+ £2 (i-i'-l) + e 3 (A:-/c') + a /n 
sgn(ei (i-i') + e 2 {j - f ) + e 3 (A - A/ - 1) + a /n 



(3.52) 



where we have broken up the integrals into diagonal and off-diagonal components in the summations 
over the colour indices, and denoted ai n := a/ — a n . 

In the U(1) N phase one has a\ n 7^ for all 1 < I 7^ n < N, for otherwise the gauge symmetry 
would be enhanced. Then one can always choose the infrared regulators ei and e 2 such that 
ei M + e 2 L + ai n 7^ for any pair of integers M, L, in addition to the Calabi-Yau condition (|3.9h . 
This ensures that the signum functions containing these vevs are never zero. It is easy to see that 
in this case one has 



h Mdiag 



E ; i u i {1 \n) 
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JV N 
-1% Woffdiag _ (—1)1^1 



C 



l,n=l 



-i 2 (^Jdiag P -T,i i 2 (n) 



e -/ a (T)offdiag = j ; (3 53) 

and hence the full contribution is given by 



e-ifW^W-J^OT = e-E^W^VO) ( J| j . (3.54) 

J,n=l 

Using the abelian result (|3.45|) to get 

e~ I ? W M- I Z W M = (-l)M , (3.55) 
we arrive finally at the instanton measure 

T U(1) N T U(1) N ATI ->, 

Combining this result with the weights (|3.37|) leads to the partition function (|3.1|) . 

4 Matrix equations and moduli of stable coherent sheaves 

The purpose of this section is two-fold. Firstly, we will recast the BPS solutions of the non- 
commutative gauge theory explicitly in purely commutative terms, by relating the counting of 
noncommutative instantons to the counting of a special class of stable coherent sheaves in three 
dimensions. This gives a geometrical explanation for and generalizes the natural gauge theoretical 
identification between the compactified instanton moduli space JA(X) and the Hilbert scheme of 
points Hilb fc (X) in the abelian case N = 1 when the underlying variety is X = C 3 . Secondly, 
we will exhibit an ADHM-like parametrization of the equations defining M(C 3 ), analogous to the 
four-dimensional case. This will naturally bridge the noncommutative gauge theory formalism with 
the topological matrix quantum mechanics that we will introduce in the next section. This matrix 
model is equivalent to a quantization of the collective coordinates of the gauge theory around an 
instanton solution, and it will provide an alternative means for analysing the six-dimensional coho- 
mological gauge theory. As before, we begin by summarizing the main results of this section before 
plunging into the detailed technical calculations. 



N 



4-1 Statement of results 

There are natural mappings between isomorphism classes of the following three objects: 

(A) U(N) noncommutative instantons on C 3 of topological charge CI13 = k. 

(B) Linear maps Bi £ End(V"), i = 1,2,3, I £ Hom(W, V) and J,K G Hom(V, W) which solve 
the "ADHM-type" matrix equations 

[B 1 ,B 2 ]+U = 0, 
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[B 1 ,B 3 ]+IK = 0, 
[B 2 ,B 3 ] = 0, 

3 

J2[Bi,Bj]+lP -JU-K^K = 31y (4.1) 
i=l 

on finite-dimensional hermitean vector spaces V = C k and W = C N , modulo the natural 
action of U (V) given by 

B t — > gB i9 - 1 , I i — ► gl , J i — ► J^ 1 and .— K^ 1 . (4.2) 

(C) Rank A~ torsion-free sheaves £ on P 3 with cli3(£) = k, fixed trivializations on three lines at 
infinity, vanishing i? 1 (P 3 , £(— 2)), and satisfying certain stability conditions. 

These three classes are not equivalent but rather represent alternative characterizations of one 
another. We conjecture isomorphisms between the moduli spaces of data (A), (B) and (C) of fixed 
topological type, after appropriate specifications of additional structures. This requires modification 
of some of the natural maps defined below, which are generically not isomorphisms but merely 
birational morphisms at best. 

The map from (A) to (B) follows from a rewriting of the noncommutative DUY equations 
in (|3.7p using special properties of projective modules over the noncommutative space [24J. 
The map from (C) to (B) follows from detailed calculations in sheaf cohomology which rewrites the 
sheaves £ as the cohomology of certain complexes of sheaves on P 3 . It canonically identifies both the 
DO-brane and D6-brane Chan-Paton spaces V C "K and W as certain sheaf cohomology groups. In 
particular, W is associated with the framing of £. The last equation of (|4.ip is a stability condition. 
Combined with the linear maps 4> £ End(V), P £ Hom(W, V) solving the matrix equations 

[B u <p] = eiB 1: 
[B 2 ,<p\-PJ = e 2 B 2 , 

[B 3 ,4>]-PK = e 3 B 3 , (4.3) 

which come from the noncommutative Higgs fields $ obeying (j3.8fl . it will be used in the next 
section to formalize the connection between the equivariant model and the statistical mechanics of 
three-dimensional random partitions. 

4-2 Linear algebra of noncommutative instantons 

In the previous section we described charge k noncommutative instantons in six dimensions as 
elements of the algebra M/v X iv(C) <8> A acting on the free module W <S> A = A® N of rank A^ over 
the noncommutative algebra A. The K-theory of the algebra A is the abelian group Z © Z, with 
positive cone No © No- Thus every projective module &k,N over A is labelled by a pair of positive 
integers k, N, which represent exactly the instanton number and rank respectively. Explicitly, one 
has pi] 

£ kN =J£®*©yi© JV (4.4) 

where as before "K is the Fock space (13. lip . The key to obtaining a set of matrix equations which 
describes six-dimensional noncommutative instantons is the existence of a natural isomorphism 
E kiN ^ A® N of yi-modules. 
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A connection V : S-k,N ~^ &k,N ®a ^a Educes a decomposition of the covariant coordinates 
Z l £ Endyi(£fc 7v) with respect to the splitting (|4.4|) as 

zl - { B r £) • * - (t Q - * - (S £) • w> 

Using irreducibility of the Fock module IK, we note that the rank one free module A can be 
decomposed into countably many copies of !K as A = ©„ 6 pj P n ■ -Aj where P n = |n)(n| is an 
orthogonal system of projectors onto one-dimensional subspaces. For each n £ No, the mapping 
Pn'f^ ( n \f establishes an isomorphism P n -A = 'K of .A- modules. Using this identification, in (|4.5p 
we regard G Mfc X fc(C) as linear operators acting on a finite-dimensional hermitean vector space 
V ^ C fc , while R4 £ End A (W (8) A) with W = the finite-dimensional Chan-Paton multiplicity 
space as in the previous section. The off-diagonal entries in eq. (j4.5jl are operators 



I , J' , K' £ Rom A {W ® A,V) and I', J , K £ H.om A (V, W <g> A) . (4.6) 

In the following we will use the gauge choice I' = J' = K' = 0. 

Then the first instanton equation of (|3.7p yields the sets of equations 



along with 



[5i,5 2 ] +/ Jo = and [R 1} R 2 ] - J 1 = , 

[S 1) fl 3 ] + io^o = and , R 3 ] - K 1 = , (4.7) 

[B 2 ,B 3 ]=0 and [R 2 ,R 3 ] = 



R 1 J -J Bi=0, Ri K - K B 1 = and I R 2 -B 2 I = (4.8) 



plus 

R 3 J -J B 3 = R 2 K -K B 2 and I R 3 - B 3 I = . (4.9) 
The second instanton equation in (|3.7p yields the sets of equations 

3 



i=l 
3 

1=1 

Jo M - 4 R2 - Kl R 3 = B\ Jo - B 2 4 - B 3 k\ . (4.10) 
Let us now decompose the off-diagonal operators in eq. (|4.5f) as 

/ = /®^j G Honu(W ^yi eAf , V) = Hom(W,V) ® End^(A ffijV ) (4.11) 
with I G Mfc X jv(C) and 

J = J®%bj,K = K(g)ip K £ Hom^(U, W®A® N ) ^Rom(V,W) ®End A (A m ) (4.12) 

with J, K £ MjVxfc(C), where the elements of Mn x n(C) A satisfy tpiipj = ipiipK = ^-W®A- In 
this way we arrive, from (|4.7p and (|4.10p . at the matrix equations (|4.ip . 

We have thus found that the set of ADHM-type data 

(Bi]I,J,K) £ Hom(V,V)® 3 © Rom(W,V) © Hom(V, W)® 2 (4.13) 
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can be used to characterize the noncommutative instantons. However, this set of data is not likely 
to be complete, i.e. a solution to the set of matrix equations (|4.ip need not yield a solution 
(Ri]ipi, ip j, ipic) to the remaining equations in (|4.7j) - (|4.10p . One can also reformulate the equivari- 
ant equations f|3.8j) of the O-background as matrix equations by writing the adjoint scalar field <*? 
in the block form 

Po 



• ;j (4.i4) 

with respect to the splitting of the projective module (|4.4jl . Then the matrix equations for the 
k x k matrix <j> in the gauge P' = are given by (|4.3|) with Pq = P ®ipi. In the next section these 
equations will be interpreted as the compensation of the toric action T 3 by a gauge transformation 
in an associated topological matrix model. 

Finally, let us see how to explicitly map solutions of the matrix equations (|4.1j) onto noncommu- 
tative instanton solutions on the free module A® N . The partial isometry equations (|3.14p identify 
the fc-dimensional subspace V := keiU n . In particular, the linear operator Jj\ has a trivial kernel, 
while U\ has a one-dimensional kernel which is spanned by the vacuum vector |0,0,0). It follows 
that as A-modules there is a natural isomorphism ker U n = 'K® k and hence one can identify the 
projective module (|4.4p with 

£ ktN *bx(U n )®A® N . (4.15) 
We may now define an invertible mapping /i : S.k,N A® N by 

KZ, f) = e + Ul ■ f and M - x (/) = (n n (/) ,U n -f) . (4.16) 

Under this isomorphism of projective .A- modules, the image of an arbitrary covariant coordinate 
Z G Endyt(£fc 7v) represented as 

z = ( B j i) <« 7 > 

is the element of End A (A® N ) ^ M NxN (C) ® A given by 

A*(z) = n„ 5 n n + n n /+ j c/„ + u\ j j f n„, + u\ r u n . (4.18) 



An explicit construction of the data (|4.13p for U (3) gauge group may be done by an elementary 
extension of the construction of [33j for the four-dimensional noncommutative U{2) ADHM data. 
The U(3) noncommutative instanton solutions of [29] can be written in the form A = ^ d\J7, 
where ^ G Hom^.(Wo ^ A, 8,^,3)- These solutions can again be extended to generic U(N) gauge 
group following the technique explained in Section 13.31 We will not explore further details of this 
construction in this paper. 



4-3 Beilinson spectral sequence 

In the remainder of this section we will show that the matrix equations (|4.ip provide a geometrical 
interpretation of the noncommutative instantons satisfying the six-dimensional DUY equations on 
C 3 . For this, we will generalize an analogous construction in four dimensions exhibited by Nakajima 
in [M] (see also [35] and [36]). Since it is more convenient to work with compact spaces, we regard 
an instanton on C 3 as a holomorphic bundle on P 3 with a trivialization at infinity. To compactify 
the instanton moduli space we include all semistable torsion free sheaves on P 3 with a trivialization 
condition at infinity and the appropriate topological quantum numbers of an instanton on C 3 . This 
allows for singularities of the instanton gauge field on C 3 , with the singularity locus the support 
where the torsion free sheaves fail to be holomorphic vector bundles. 
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We are thus interested in the framed moduli space of torsion free sheaves given by 
MM k (F 3 ) = 



£ = torsion free sheaf on F 6 
rank(£)=iV, <*(£) = . , . 

ch 2 (£) = , ch 3 (£) =k ( I isomorphisms (4.19) 



c I ~ 

\Pi — Pi 

c oo oc 

where f^, i = 1,2,3 are three projective lines at infinity which will be specified explicitly below. 
The moduli space (14. 191) corresponds to the counting of D0-D6 bound states on C 3 in a suitable 
-B-field background, as we demonstrate explicitly in the next section. Following [31], we will use 
the Beilinson spectral sequence to parametrize a generic torsion free sheaf £ and then show that 
this spectral sequence degenerates into a complex of sheaves on P 3 which is related to solutions 
of the matrix equations (14. IB . The Beilinson theorem in our case implies that for any torsion free 
sheaf £ on P 3 there is a spectral sequence with s-th term E%' q which converges to £ if p + q = 
and to zero otherwise. 

The Beilinson spectral sequence can be constructed by starting with the product space P 3 x P 3 
and the canonical projections onto the first and second factors 

(4.20) 




Then for any coherent sheaf £ on P 3 one has the projection formula 

Pi*{p* 2 Z®0 A ) =Pi*(P2£| A ) = £ (4-21) 
where A = P 3 C P 3 x P 3 is the diagonal. In the following we will use the notation 

£iH£ 2 :=Pi£i®P2£ 2 (4.22) 
for the exterior product over P 3 x P 3 of two sheaves £i, £2 on P 3 . 

The next step consists in replacing the structure sheaf Oa of the diagonal with an appropriate 
projective resolution, which we will take to be given by the Koszul complex. Consider the short 
exact sequence which defines the tangent bundle to P 3 by 

^O p3 ^O p3 (l)© 4 ^T p3 ^0 . (4.23) 

If we tensor this sequence with P 3(— 1) we get the short exact sequence 

-O p3 (-l) -O© 4 -0 , (4.24) 

which defines the universal quotient bundle Q = T P 3 (8) P 3(— 1) and its dual Q* = J7p 3 ® P 3(1) 
where f2p 3 is the sheaf of one-forms on P 3 . Then the Koszul complex is given by [37] 

— ► A 3 (Op3(-i)^Q*) — ► A 2 (Op3(-l) ^ Q* ) — ► O p3 (-l)KQ* — ► 

— ► P 3 XP 3 — > A — ► . (4.25) 

From this complex we can construct a spectral sequence by taking an injective resolution of the 
hyperdirect image of eq. (|4.2ip . and replacing Oa with its Koszul resolution. More details can be 
found in |37l Chapter 2 §3.1] and [341 Chapter 2]. By introducing 

CP ■= A -p (O p3 (-l)KQ*) (4.26) 
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the double complex can be expressed as the Fourier-Mukai transform 



fl'pi*(psi£®C") , 



(4.27) 



where R° is the right derived functor in the bounded derived category of coherent sheaves on 
Note that each term of the Koszul resolution has the form 



(4.28) 



The Beilinson theorem then implies that for any coherent sheaf £ on P 3 there is a spectral 
sequence Eg' q with £i-term 

gP' q = $[ ® H q (P 3 , £ ® 3f ) (4.29) 

which converges to 

' fi(-r) , ifp + g = 0, 
, otherwise 



'rvi 



(4.30) 



for each fixed integer r > 0, where we denote £(— r) := £ <S>o P 3 Op 3 ( — r )- Explicitly, the first term 
is given by 

(4.31) 



E™ = #"(P 3 , £(-r) ® n^f(-p)) ® O p3 (p) 



for p < 0. The i?i-term complexes of the spectral sequence can be summarized in the diagram 

d l ,-,-2.3 d l ,-,-1.3 d i 



^-3,3. 



E 



E 



E- 



-3,2 



-3,1 



di 



E\ 



-2,2 



El 



E\ 



E\ 



,0,3 



-1,2 



E 



,0,2 



di 



El 



-3,1 



-3,0 



E\ 



-2,0 



^1 



-1,1 



di 



E\ 



0,1 



-1,0 



E 



,0,0 



(4.32) 



7^ 

where all other entries are zero for dimensional reasons and the only nonvanishing differential 

dl . Ef' q — ► (4.33) 



is determined by the morphisms in the Koszul complex (I4.25|) . The double complex (|4.32p is an 
object of the derived category. Our goal in the following is to reduce it to an object of the stable 
category of coherent sheaves on P 3 . Physically, this can be thought of as the stabilization of a 
topological B-model brane to a Type II A D6-brane wrapping P 3 . 

The last ingredient we will need comprises a few short exact sequences that will play an impor- 
tant role in explicit computations. They are given by 



0- 



0- 
0- 



-O 1 
-O 2 



_!)©4_ 
-0 P a(-2)© 6 - 



Poo 
Op3" 

O 1 - 



-o , 
-o , 
-o , 



(4.34) 
(4.35) 
(4.36) 
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-tt 3 3 ^0 P 3(-3)© 4 -0 2 3 -0 . (4.37) 

The first sequence defines the plane at infinity p^ = [0 : z\ : Z2 ■ 23] — P 2 , while the other three 
sequences are the Euler sequences for differential forms on P 3 obtained via truncation of the Koszul 
complex. 

The final stage consists in imposing suitable boundary conditions on the sheaf £. The appropri- 
ate boundary conditions were found in [S] and consist in imposing that the sheaf £ restricted to the 
projective plane P 2 at infinity corresponds to a four-dimensional instanton, viewed as an asymptote 
of the corresponding three-dimensional partition. By this we mean that it has the same cohomolog- 
ical properties as the torsion free sheaves on P 2 studied in [3l]. This condition should be imposed 
separately along each of the three complex "directions" in C 3 , i.e. the six-dimensional generalized 
instantons should behave in a different way when Zi — > 00, i = 1,2,3, corresponding to generically 
distinct two-dimensional Young diagrams (partitions). Since C 3 = P 3 /P 2 , the three correspond- 
ing projective planes at infinity are given in homogeneous coordinates by p^ = [zq : : Z2 ■ Z3), 
Poo = i z o '■ z\ : : 23] and p 3 ^ = [zq : z\ : z% : 0] , and each one contains a line at infinity defined 
by zq = 0. We then impose the boundary condition that £ is trivial separately on each one of these 
three lines. With this choice of trivializations one automatically has ci(£) = 0, and the sheaves 
£Li have quantum numbers 

c i( £ UJ = and ch 2( £ lp^) = P2(£|p*J = h • (4.38) 

These are torsion free sheaves on P 2 of rank N trivialized on a line l 1 ^ which represent framed 
four-dimensional instantons of charge hi. By T-duality, they correspond to D6-D2 bound states on 
P 3 of D2-brane charge fcj. 

The vacuum moduli space (|4.19|) is recovered by setting fcj = f ' t cli2(£) = 0. These are the 

Poo 

boundary conditions appropriate to the gauge theory on C 3 and will be the case studied in this 
section and in Section [5j In Section [6] we will need the more general non-trivial asymptotics (|4.38p . 
We will now impose this boundary condition in three steps, dealing with the different terms of 
the spectral sequence. A closely related moduli space of instanton sheaves has been rigorously 
constructed recently by Jardim in |38j . 

4-4 Homological algebra 

The first step is to determine E^ 3,9 and E® ,q . These terms can be treated simultaneously because 
3 3 = Op3(— 4). Let us tensor the sequence (|4.34p by £(— r) to get 

„£(_ r _ 1) ^£(_ r ) U(-r)\ pgo -0 , (4.39) 

where we have used the fact that P 2 is a locally free sheaf to set Tor 1 (£(— r)\ Poo , Poo ) = 0. 
Applying the snake lemma one finds the associated long exact sequence in cohomology 

-tf°(P 3 , E(-r-l)) -#°(P 3 , £(-r)) ^if°(P 2 , £(-r)| poo ) (4.40) 

^H 1 (P 3 , £(-r-l)) ^H 1 (P 3 , £(-r)) ^(F 2 , £( 

-tf 2 (P 3 , £(-r - 1)) ^H 2 (P 3 , £(-r)) ^H 2 (F 2 , £( 

^H 3 (P 3 , £(-r - 1)) ^H 3 (P 3 , £(-r)) ^0 



-r 



-r 



p > 



'Poo 
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Since £| Poo is a sheaf on P 2 which is trivial when restricted on a projective line P 1 C P 2 , we are 
in the same situation as in [3i\ Chapter 2]. It follows that 

H°(¥ 2 , £(-r)| ) = for r > 1 , (4.41) 

H 2 (F 2 , £(-r)| ) = for r<2. (4.42) 
By imposing this condition on the cohomology long exact sequence (I4,40p we find 

H 3 (P 3 , £(-r - 1)) = H 3 (P 3 , £(-r)) for r < 2 , (4.43) 

#°(P 3 , £(-r-l)) = #°(P 3 , £(-r)) for r>l. (4.44) 

By Serre's vanishing theorem [37], -ff 9 (P 3 ,£(m)) = is trivial for m ^> and g / 0. Combined 
with Serre duality this implies 

H 3 (P 3 , £(-r)) =0 for r < 3 , (4.45) 

F° (P 3 , £(-r)) =0 for r > 1 . (4.46) 

The second step is to determine E± ' q . Let us start by tensoring the exact sequence fj4.34H with 
£(-r)®OL(l) to get 



^ 3 (1) £(-r - 1) ^ 3 (1) ® £(-r) (fijs(l) ® | Poo -0 . (4.47) 

Since (fip 3 (l) (g) £(— r)) | is a sheaf defined on = P 2 which trivializes on a line P 1 C P 2 , we 
are again exactly in the situation of |34} Chapter 2] and hence 

H°(F 2 , (fi p3 (l)®£(-r))| p J =0 for r>l, 

F 2 (P 2 , (fiis(l) £(-r))| ) = for r < 1 . (4.48) 

V lr 'Poo * 

From the corresponding long exact sequence in cohomology we have 

H 2 (F 2 , (fii 3 (l) $5 £(-r))| poo ) -# 3 (P 3 , njafl) ® £(-r - 1)) (4.49) 

-tf 3 (P 3 , nja(l)®£(-r)) -0 . 

By imposing the conditions (|4.48|) and (|4.43|) we get 

H 3 (F 3 , njs(l)®£(-r)) =0 for r<2. (4.50) 

We get other conditions by tensoring the Euler sequence for one- forms (14.350 with £(— r) to get 

-£(-r) ® 0^(1) -£(-r)© 4 *£(-r + 1) -0 . (4.51) 

The corresponding long exact cohomology sequence is 
^H°(F 3 , £(-r)®fi p3 (l)) -#°(P 3 , £(-r))® 4 (P 3 , £(-r + 1)) (4.52) 

^H 1 (P 3 , £(-r)®^ 3 (l)) -tf 1 (P 3 , £(-r))® 4 -F 1 (P 3 , £(-r + l)) 

-tf 2 (P 3 , £(-r)®fi* 3 (l)) -# 2 (P 3 , £(-r)) 04 ^H 2 (P 3 , £(-r + 1)) 



tf 3 (P 3 , £(-r)®fi p3 (l)) -# 3 (P 3 , £(-r)) ffi4 ^H 3 (P 3 , £(-r + 1)) -0 
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From the first line of this sequence, by imposing (14.460 we get 

H°(F 3 , njs(l) ®£(-r)) =0 for r>l. (4.53) 

The third and final step is to determine E^ 2 ^ ■ From the Euler sequence for three-forms (|4.37p 
we get 

-£(-r-2) ^£(_ r -l)®4 ^£(_ r ) ® ^ 3 (2) -0 . (4.54) 

Let us look at the corresponding long exact sequence in cohomology. It contains, in particular, the 
line 

^H 3 (P 3 , £(-r-2)) -tf 3 (P 3 , £(- r -l))® 4 (4.55) 

^H 3 (P 3 , £(-r)®J2j,(2)) -0 . 

By imposing the condition (14.450 one gets 

H 3 (P 3 , £(-r) ® 0^3 (2)) =0 for r < 2 . (4.56) 

The only short exact sequence that we haven't yet used is the Euler sequence for two-forms 
(|4.36p from which it follows that 

-£(-r) ® -£(-r - 2)® 6 ^£(-r) (8) 0* 3 -0 . (4.57) 

The corresponding long exact cohomology sequence yields 

^°(P 3 ,£(-r)®Oy ^H°(P 3 , £(-r-2))® 6 *H° (P 3 , £(-r)®^ 3 ) (4.58) 

-tf 1 (P 3 , £(-r)®S^ 3 ) ^ p3) £ (_ r _ 2 ))©6 £ (_ r ) fii 3 ) 

^H 2 (P 3 , £(-r)®5^ 3 ) ^ 2 ( P 3 5 £( _ r _ 2) )©6 ^ R 2 ( p s 5 g(_ r ) 0n i 3 ) 

-# 3 (P 3 , £(-r) n 2 p3 ) ^H 3 (P 3 , £(-r - 2)) 06 

-F 3 (P 3 , £(-r) ® n^) -0 . 

By using (14.460 and (|4.53|> we get 

H° (P 3 , £(-r) ® fi£s(2)) =0 for r > 1 . (4.59) 

If we collect all the results obtained so far, we see that the values r = 1,2 are rather special 
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since then all the cohomology groups H° and H 3 vanish and the spectral sequence becomes 



E\ 



E 



-3,2 



-3,1 



E 



-2,2 



E\ 



-3,1 



dj 



El 



1,2 



-1,1 



di 



0,2 



,n0,l 



(4.60) 



P 

A great deal of information can now be obtained with the help of the Riemann-Roch theorem 
which computes the Euler character 



X(9") = E(- 1 ) <? dimctf* (P 3 ,J) 

q=0 



ch(3 r ) Atd( 



(4.61) 



for any sheaf 9" on P 3 . We are interested in the cases where 5F is £(— r), £(— r) (g> f2p 3 (l) and 
£(— r) (8) Op 3 (2). Using (|4.19p we parametrize the Chern character of £ as 



ch(£) = N + kf 



(4.62) 



where £ = ci(0p3(l)) is the hyperplane class which generates the complex cohomology ring of the 
projective space P 3 . 

The pertinent values of the Chern and Todd characteristic classes may be computed from the 
exact sequences (|4.34|) - (|4.37|) and are given by 



ch(0 p3 (-r)) 
ch(f2p 3 ) 
ch(f2p 3 ) 
td(P 3 ) 



3 - 4£ + 2f - | f , 
3 - 8£ + 10^ 2 - f £ 3 , 
1 + 2^ + if f + f ■ 



(4.63) 



To apply the Riemann-Roch formula (I4.6ip we use the multiplicativity property of the Chern 
character ch(£i (g) £2) = ch(£i) A ch(£2) and the fact that only the top form components £ 3 survive 
the integration over P 3 . We will only need to deal with the case r = 2 explicitly below, for which 
the relevant results are 

x(£(-3)) = k, 
x(£(-2)0ft 2 3 (2)) = 3& + iV, 
X (£(-2)®Ol 3 (l)) = 3k, 

x(£(-2)) = k. (4.64) 



4-5 Nonlinear Beilinson monad 

We will now impose an additional condition on the sheaf £ which ensures that the spectral sequence 
becomes a four-term complex and that the Euler characteristics computed in eq. (|4.64p above are 
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the stable dimensions (rather than virtual dimensions) of the vector spaces which appear in the 
complex. The condition we impose kills all the H 1 cohomology groups and simplifies the spectral 
sequence in the case r = 2. It is given by 



H 



£(-2)) = 0. 



(4.65) 



This is the same condition which is placed on the holomorphic bundles over P 3 that are used in 
the twistor construction of framed instantons in four dimensions [35J. It is also similar to the one 
defining the admissable sheaves of [39] . 

If we look at the long exact sequence (I4,40p for r = 2 with the condition (I4.41D and impose 
(|4.65|) . we immediately see that 

H 1 (P 3 , £(-3)) = . (4.66) 
Moreover, if we consider the sequence (|4.52p with r = 2 and impose both (|4.46|) and (|4.65|) we find 

'' /to3 , £(-2)®n^(l)) =0 . (4.67) 



H 1 



Finally, let us look at the cohomology sequence (|4.58p for r = 0. By imposing (|4.65jl as well as 
(|4.53p one finally finds 



H 1 



£(-2) ® n^) = . 



(4.68) 



The condition (|4.65p thus automatically kills the Ef' 1 line and the spectral sequence reduces to 



-3,2 



-2,2 



El 



1,2 



di 



0,2 



(4.69) 



P 

This is our candidate for a generalized ADHM-like complex. The cohomology computations above 
also serve to show that the spectral sequence degenerates at the I?2-term. If we remember the 
Beilinson theorem, then we can write the cohomology of the differential complex in (|4.69p as 



Er 







-3,2 







K 



-2,2 



£(-2) 



K 







-1,2 







P 0,2 



















p 



(4.70) 



Equivalently, we have the complex 
® O p3 (-3)— ±+B (8) O p3 (-2)— b -+C (8) p3 (-l)-^£) ® O P 3(0) ^0 , (4.71) 
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where we have defined the complex vector spaces 

V = H 2 (F 3 , £(-3)) , 

B = H 2 (F 3 , £(-2)®fi§s(2)) , 

C = H 2 (F 3 , £(-2)®nJ 3 (1)) , 

D = H 2 (F 3 , £(-2)) . (4.72) 

It is straightforward to show that there is a natural identification D = V . Using the vanishing 
cohomology groups above, the long exact sequence (|4.40p truncates for r = 2 to 

^(P 2 , £("2)| poo ) ^H 2 (F 3 , £(-3)) ^H 2 (F 3 , £(-2)) -0 . (4.73) 

Since the four-dimensional instanton numbers in (|4.38|) are given by [34J ki = dime -ff 1 (P 2 , £(— 2)\ p i ), 
for the vacuum moduli space (|4.19p one has H l (F 2 , £(— 2)| Poo ) = and hence 

if 2 (P 3 , £(-3)) = H 2 (P 3 , £(-2)) . (4.74) 

A similar argument provides a natural identification 

c = v e v e v . (4.75) 

Indeed, using (QUI) with r = 1 identifies V = H 2 (F 3 , £(-1)), since H 2 (F 2 , £(-l)| Poo ) = exactly 
as above [34) . Then the exact sequence f)4.52f) with r = 2 implies (|4.75p . 

By ()4.70p . the cohomology of the complex (|4.7ip gives the sheaf £(—2). To get a complex whose 
cohomology is simply £ all we have to do is tensor by Op3(2) to get the equivalent complex 

® Ops(-l)^+B ® O p3 — b -+V® 3 ® F 3(1)^+V ® O p3 (2) ^0 . (4.76) 

The crucial point is that the complex vector spaces appearing here are finite dimensional. If we 
look at eqs. (|4.64p . then one has dime V = k and dime B = 3k + N. 

Looking back at eq. (|4.70p . we see that the only non-trivial cohomology group of the complex 
(I4.76P is the coherent sheaf 

£ = ker(fo)/im(a) . (4.77) 

In particular, the map c is an epimorphism, a is a monomorphism, and ker(c) = im(6). Using this 
last condition, we can truncate (I4.76P to a three-term complex by replacing V® 3 <8> 0p3(l) with the 
locally free kernel sheaf % c := ker(c), which describes the sheaf £ as the cohomology of a nonlinear 
monad 

JVC : ^V® ¥3 (-l)—^B ® O p3 -^3C c ^0 (4.78) 

with dime V = k and dime B = 3k + N, for which the map b is an epimorphism and a is a 
monomorphism with ba = 0. 

Since £ is the only nonvanishing cohomology of the complex (|4.78l) . we can compute its Chern 
character through 

ch(£) = ch(B ® O p3 ) - ch(V (8) p3 (-l)) - ch(D^ c ) . (4.79) 

By comparing with ()4.62p and (I4.63P , we see that the bundle % c on P 3 has non-trival characteristic 
classes in all degrees determined entirely by the instanton number k. In particular, one has 

rank(3C c ) = 2k and ci(3C c ) = k . (4.80) 
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One also finds from (14.790 that X c cannot be of the form K <g> Op3(l) for some 2/c-dimensional 
hermitean vector space K, reflecting the nonlinearity of the monad (|4.78p . 

One can adapt the proof of |37[ Lemma 4.1.3] to show that the complex (|4.76p determines the 
sheaf £ uniquely up to isomorphism. This is equivalent to the requirement that 

Ext 9 (X, p3 (-l)) = Ext 9 (D<: c ,0 P 3) = (4.81) 

for all q, which follows from the fact that the kernel sheaf is locally free and guarantees that 
the nonlinear monad (|4.78p is unique up to isomorphism. In the following we will find it more 
convenient to work instead with the equivalent four term complex (|4.76p . 

4-6 Barth description of nonlinear monads 

We will now give a description of the moduli space (|4.19p . under the conditions spelled out above, 
in terms of linear algebra by generalizing the Barth description of linear monads [35]. This will 
contain as a special case the matrix equations (|4.ip describing the six-dimensional noncommutative 
instantons. For this, we regard the morphism c in (|4.76p as an element of (V*)® 3 (g> V <8> W, where 
W = H°(¥ 3 , P 3(1)) is the vector space spanned by the homogeneous coordinates zq, z±, z 2 , z 3 of 
P 3 . The map c can then be written as 

c = c z Q + Ci zi + c 2 z 2 + c 3 z 3 , (4.82) 

where Cj : U® 3 — > V are constant linear maps. Similarly, we can represent the morphisms a and b 
of the four-term complex (|4.76p as 

a = a z + ai Z\ + a 2 z 2 + a 3 z 3 and b = b z + h z\ + 6 2 z 2 + 63 ^3 (4.83) 

where a, : V — > B and b{ : B — > V® 3 are constant linear maps. The monadic condition ba = then 
implies that 

bi ai = and hi a,j + bj Oj = (4.84) 
for each i,j = 0, 1, 2, 3 with i < j. On the other hand, the condition ker(c) = im(6) implies that 

ker(cj) = im(6j) and q bj + Cjbi = . (4.85) 
Restricting the complex (|4.76p to the line at infinity = [zq : Z\ : : 0] = P 1 C P 3 we get 
>Y ® Op8(-l)| /oo -^B ® Q p3 |^_^y©3 g, <Q^)\ iaa ^+V ® Op3(2)| £oo -0 (4.86) 

where a^ = ao zq + a\ Zx,b oa = bo zq + 61 z\ and Cqo = cqZq + c\ z\. The kernel sheaf %b = kei(b) 
is locally free, and one has the exact sequence of sheaves 

^V®O p3 (-l)L -^*-X b \, ^0 (4.87) 

where the third arrow comes from the projection onto (|4.77p . Using the associated long exact 
sequence in cohomology, along with H 9 (F 1 , Opi (— 1)) = 0, q = 1,2 and = 0®^, we conclude 
that F^P 1 ,^!^) = and H°(F 1 ,X b \ £QO ) ^ H° (P 1 , £,\ £oo ) ^ £ p where £ p is the fibre of £ at some 
point p £ £oc- We set 

W = H°(P 1 , X b \ £oo ) . (4.88) 

This is a complex vector space of dimension rank(£) = iV and a choice of basis for W corresponds 
to a choice of trivialization for fi^. More general framing data, for which can contain a sum 
of non-trivial line bundles, are considered in |13j . 
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Similarly, from the exact sequence 

^b\ ioc *B <g> P 3|^-^y® 3 © P 3(l)|^^2^y ® °P 3 ( 2 )L -0 , (4.89) 

along with # (P\ P i) = C and H l {¥ 1 ,% b \ loc ) = 0, we obtain 

>-W ^B^^V m © H° (P 1 , P i (1)) -^V <g> iJ° (P 1 , P i (2)) -0 . (4.90) 

Using the identifications F°(P\ P i (1)) = Cz ©Czi and iJ^P 1 , P i (2)) = Czg © Cz ^i © <Czf, we 
can rewrite (I4.90P as 

( b °) 

W B U© 6 V® 3 , (4.91) 



where generally we define 



, 

33 m 



7ij := I Cj a\ : V® 3 ®V® 6 — > V ®V ®V (4.92) 
.0 Cj, 

for < i < j < 3. It follows that W = ker(6 ) n ker(6 x ) and that 7 J j : (U*)© 3 -> (U*)© 6 is 
injective. 

Let us now apply the same argument to the dual complex 
.-V*® Ops (-2)1, -^k(U*)© 3 ® p3 (-l)L -^5*® Ops I- -^F»0 P 3(1)|, ^0 



(4.93) 

whose cohomologies before restriction to are !Kom (£, Op3) and £xt 1 (£,0 P 3), where we have 
used Ext 1 (0 P 3(2), P 3) = 0. After tensoring with Opi(l), this yields the exact sequence 



(b y 

- H ^ 1 , ker(cL)) (V*)® 3 5* © (U*)© 3 (4.94) 

which implies that the linear map 

aoi:=r n ° ai °) :V®V®V — ► B®B (4.95) 

is injective. Using the exact sequence (I4.9ip along with dime B = 3 dime V + dime W, we can thus 
identify 

B = V@V®V®W. (4.96) 

Furthermore, since 

ker(6 ) /im(ao) = £[i :0 :0:0] = ^ = M&o) n ker(&i) (4.97) 

one has im(ao) n ker(&i) = 0. It follows that 60 0,1 = —b\ ao : V — ► V® 3 is injective. 

Using the monadic conditions 60 &i + &i a o = and 60 «o = = 61 ai, we can choose bases for 
the vector spaces V, W, B and C = V® 3 such that the injection bo a\ is given by 

6001 = I Ofexfe I (4.98) 



4,i 



.1 



kxkj 
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along with 



a 



( Ofc X fc\ 

Ifcxfc 
Ofcxfc 



\ 



( Ofcxfc 
Ofcxfc 
Ifcxfc 

\OiVxfc/ 



(Ifcxfc Ofcxfc Ofcxfc Ofcx7v\ 
Ofcxfc Ofcxfc Ofcxfc OfcxJV I , 
Ofcxfc Ofcxfc Ifcxfc OfcxAT/ 

Ofcxfc Ofcxfc Ofcxfc OfcxAr\ 
and bi = | —Ifcxfc Ofc X fc Ofc X fc OkxN J 

Ofcxfc —Ifcxfc Ofcxfc OfcxAr/ 



(4.99) 



Using the conditions ker(co) = im(&o), ker(ci) = im(&i) and cq bx + ci 60 = we can then write the 
maps 

Co = (Ofcxfc Ifcxfc Ofcxfc) and ci = (ifcxfc Ofc X fc Ofc X fc) . (4.100) 

Using the equations b 2 ao + &o 0-2 = = b 2 «i + bx 0-2 and 63 ao + 60 ^3 = = 63 ai + bx 03, together 
with C2 60 + Co b 2 = = C2 bx + ci 62 and C3 60 + Co 63 = = C3 61 + ci 63 , we can parametrize the 
remaining linear maps in the form 



a-2 



a3 



f B 'i\ 
Bx 

B 2 
\JJ 

B' 2 

B's 
\KJ 



and 



and 



Cx 


-B[ 


Ofcxfc 


Co 


Ofcxfc 


B[ 


c 3 


-B 2 


Bx 


C'x 


-B 3 


Ofcxfc 


c> 2 


Ofcxfc 


B 3 




-B' 3 


B' 2 



I J 



OfcxiV 



(4.101) 



with B^B'^CuCl e M fc xfc(C), J,K G M Arx fc(C) and /, /' E M kxN (C), along with 
c 2 = (-C 2 d -BQ and c 3 = (-C 2 C( -5 3 ) . 



(4.102) 



It remains to satisfy the remaining equations in (I4.84p and (14.850 . From the last three equations 
62 0-2 = = 63 03 and b 2 03 + 63 a 2 = of the monadic condition we get the respective sets of matrix 
relations 



B[Bx = CxB[ and 

B[B 2 = -C 2 B[ and 

[Bx,B 2 ]+IJ = -C 3 B[ and 

along with 



B 3 B' 2 
B 3 B 3 
[B' 2 ,B' 3 ]+I'K 



C'x B 3 , 
-C 2 B 3 
—Co B 3 



(4.103) 



B 3 Bx + B[B' 2 
B 3 B 2 + B[B' 3 
[B 2 ,B 2 ] + [B 3 ,Bx}-IK-I'J . 

On the other hand, from the remaining conditions c 2 b 2 
matrix equations 



Cx B 3 + C[B[ , 
—C 2 B 3 — C 2 B l 
C 3 B 3 + C' 3 B[ . 



(4.104) 



[Cx,C 2 ] 
B[ B 2 
B[I 



B{C 3 
— C 2 B[ 




and 
and 
and 



= C3 63 we get the respective additional 
[C[,C 2 ] = B 3 C 3 , 



B 3 B' 3 



= ~C 2 B 3 

b 3 t = , 



(4.105) 
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while from c 2 63 + c 3 fe 2 = we find 



[C x ,C' 2 } + [C' Xi C 2 ] = B 3 C 3 + B[C' 3 , 

B 3 B2 + B[ B' 3 = — C 2 B 3 + C' 2 B[ , 

B 3 B\ + B[ B' 2 = C\ B 3 + C[B[ , 

B 3 I = -B[I' . (4.106) 

To investigate the solution space of the somewhat complicated system of matrix equations 
([4,1U3|) (|4,106p . we should recall that the boundary conditions appopriate to the six-dimensional 
generalized instantons on C 3 require trivializations on three independent lines P 1 C P 3 . We will 
choose the remaining two lines to be given in homogeneous coordinates by [zq : : z 2 ■ 0] and 
[0:^i : z 2 ■ 0]. We then restrict the complex (|4.76p to these lines exactly as before. By an identical 
analysis to that given above one arrives at analogous constraints on the kernels and ranges of 
the linear maps involved, which then imposes additional restrictions on the matrices satisfying 
eqs. (l4T03]H(|4TT06j) above. 

For instance, the injectivity of the linear maps 60 a 2 and b\ a 2 lead respectively to the kernel 
constraints 

ker(B[) n ker(5 2 ) = and kev(B[) n ker(Bi) = , (4.107) 

which automatically guarantees all other vanishing conditions on the maps o« and b{. Likewise, 
injectivity of 7g 2 and 7J 2 lead respectively to the range constraints 

im(S() n im(C 2 ) = and im(^) n im(Ci) = . (4.108) 

Finally, the framing data determine isomorphisms between the Chan-Paton space (|4.88[) and the 
two subspaces of vectors: 

• (u, w) G (ker(B[) n ker(C 2 )) W for which B 2 (v) = I(w); and 

• (v,w) € V W for which Bi(v) = -I(w). 

We interpret these extra constraints as stability conditions on the linear maps satisfying the matrix 
equations (j4. 1Q3|) (j4. 106j) . The issue of stability will be discussed further in Section [4~71 below and 
in Section [3 

To illustrate the use of these extra conditions, suppose that a vector v £ V satisfies the equation 
B[ B x {v) = d B[(v). Then by (|4~TU5|) one has Bi(v) = B[(v) = 0, and hence v = by (|4~TU71) . 
This implies that the linear map B[ B\ — C\ B[ : V — * V is bijective, which contradicts the first 
equation of (|4.1U3|) . Thus we set B[ = 0. Then (|4.1U3p implies the first equation of the set 
(|4.ip . It is straightforward to find that the next two equations of (14. ip follow similarly, after 
some identifications amongst the various matrices. As in Section 14.21 there are generically more 
moduli and equations than needed to identify a torsion free sheaf on C 3 with the set of matrix 
equations (|4.ip . The role of these extra moduli will be explained in Section [5.2i 

4-7 Stability 

There is a natural free action of the group GL(k, C) on the data {Bi,B'^ Cj, J, K, I, I') of Sec- 
tion 2]6] above, of the form in (|4.2p with g £ GL(k,C). As in the case of linear monads [37J, one 
can show that any isomorphism of a complex (|4.76|) which preserves the trivializations on the lines 
E 1 ^ and the choice of bases for the vector spaces V, W, B and C made above has this form. We can 



34 



restrict the complex (14.761) to C 3 = P 3 \ P 2 by setting zq = 1 and replacing Op3(— r) by C 3 every- 
where. Then on the fibre at z = (zi,Z2,Zs) £ C 3 , the morphisms a, b and c induce homomorphisms 
of vector spaces 

v®v®v 

© -^V®V®V-^V. (4.109) 

Following the analog statement for linear monads on ¥ d , one can show that whenever N > 3 
the cohomology sheaf (14.770 is nondegenerate, and hence that the cohomology of a generic complex 
(|4.76p is a torsion free sheaf on P 3 with the stated properties. Then from (|4.107p . along with 
suitable identifications of the various matrices, it follows that the localized maps a z £ Hom(y, B) 
are injective for all z £ P 3 . On the other hand, surjectivity of c z G Hom(C, V) and exactness 
ker(cz) = im(6 z ) for all z 6 P 3 , together with (14.1080 and appropriate matrix identifications, pre- 
sumably implies a certain algebraic stability condition analogous to the four-dimensional case |34j . 
Using stability along with the fact that B2 and B3 commute, one can repeat the proof of |34} 
Proposition 2.7] step by step to show that in the abelian case the maps 

J = K = for N = 1 (4.110) 

and the cohomology sheaf (|4.77|) is isomorphic to the ideal J given in the description of the Hilbert 
scheme Hilb fc (C 3 ) in terms of instantons in noncommutative gauge theory on C 3 presented in the 
previous section. The algebraic stability condition also follows from the last matrix equation in 
(14. 10 which encodes the noncommutative deformation. We will see this explicitly in the next section 
wherein we shall make the instanton complex (|4,109p equivariant with respect to the toric action 
following [341 Chapter 5] and [10], and utilize the powerful localization techniques of a suitably 
defined topological matrix model. This is tantamount to introducing the matrix equations (|4.3p of 
the fi-background. 

5 Topological matrix quantum mechanics 

In this section we will carry on with the case X = C 3 to avoid complications coming from 
a non-trivial topology of the ambient space. In this context the gauge theory computes bound 
states of D6 and DO branes with a suitable -B-field turned on. As in the four-dimensional case 
there are two ways of doing the instanton counting computation. One way is to write down the 
noncommutative gauge theory directly, solve for the critical points and compute the fluctuation 
determinants around each critical point, as we did in Section [3l The other way is to consider the 
effective field theory of a gas of k DO-branes coupled to the D6-branes. This is equivalent to a 
topological matrix quantum mechanics on the resolved moduli space. For instance, we may think 
of this field theory as arising from quantization of the collective coordinates around a fixed point of 
the original gauge theory. In the static limit, relevant for considerations involving the BPS ground 
states, this gives rise to an ADHM-like formalism which provides a dynamical realization of the 
matrix equations describing the torsion free sheaves of the previous section. This will nicely tie 
the computation in terms of noncommutative instantons into one involving the abelian category of 
holomorphic D-branes (coherent sheaves). 

The set of fields and equations of motion involved in the matrix quantum mechanics can be nicely 
interpreted as a representation of a quiver with relations, an oriented graph consisting of nodes 
and arrows together with linear combinations of paths in the graph. To provide a representation of 
the quiver diagram in the category of complex vector spaces, one associates a set of vector spaces 
to the nodes and linear maps ("fields") to the arrows which respect the relations ("constraints"). 
In the large volume limit one can represent a D-brane configuration, viewed as an object in the 



35 



abelian category of coherent sheaves, as a representation of a quiver. This ties in nicely with 
the varieties naturally associated to quivers that were introduced by Nakajima to study ordinary 
instanton moduli spacesQ One may regard the quiver construction presented in the following 
as a generalization of this formalism to study moduli spaces of solutions of the DUY equations. 
Physically we are left with a super symmetric quantum mechanics that lives on the moduli space 
of the quiver variety, whose super symmetric ground states correspond to BPS bound states in the 
original D-brane picture. The quiver quantum mechanics that describes the BPS states of the D6- 
DO system with an appropriate -B-field turned on was introduced in [12]. The connection between 
the supersymmetric quantum mechanics and the noncommutative gauge theory description of the 
D6-D0 system was suggested originally in |14j— [16j . where it was also shown that this system is non- 
supersymmetric in the absence of a B-Reld. This means that the noncommutative deformation is 
crucial for obtaining stable instanton solutions and that a description involving torsion free sheaves 
is unavoidable in this context. 

Ultimately the quiver approach and the noncommutative gauge theory give equivalent descrip- 
tions of the same physical problem, but it is important to bear in mind that in the noncommutative 
computation one is expanding the gauge theory path integral around critical points and computing 
the quantum fluctuations around the classical solutions. On the other hand, the matrix quantum 
mechanics already contains the fluctuation factors. By fixing the number of DO-branes to be k (and 
likewise the rank of the matrices), we are automatically working in what from the gauge theory 
perspective would be the charge k instanton sector. The quiver matrix model computes directly 
the equivariant volume of this moduli space. Finally, one takes back this information to the gauge 
theory. In the gauge theory, by expanding around any critical point one is left with a matrix model 
on the instanton moduli space. This is what the quiver matrix model computes. 

In this section we will begin by briefly reviewing the typical computation of ratios of fluctuation 
determinants in cohomological field theory, following the treatment of [41] . and then apply this 
formalism to the quiver matrix quantum mechanics. To compute the quiver partition function we 
will also give a classification of the critical points of the matrix model. The path integral localizes 
onto fixed points of the toric action and each fixed point is given by a solution of the equations 
(|4.1|) . The equivariant character of the complex (|4.1U9|) at a fixed point represents the linearized 
contribution of the fixed point to the partition function. Finally, the computation will be completed 
by using the localization formula. We will obtain exact agreement with the results coming from 
noncommutative gauge theory, reproducing in particular the partition function (13. ip . 

5. 1 Cohomological field theory formalism 

Let us start with a set of equations £ = 0. In our applications these will either be the ADHM- 
like equations of the previous section or the six-dimensional DUY equations of Section [3] These 
equations will be functions of some complex fields which we denote collectively by X{ and are 
assumed to transform in the adjoint representation of some U(k) gauge symmetry group. To 
construct a supersymmetric field theory one needs to supplement these fields with superpartners 
to form multiplets (Xj,^,) with BRST transformations 



The Xi are coordinates on the field space, which after imposing the constraints and gauge invariance 
becomes the moduli space, and are their differentials. 

lr The original motivation was to understand moduli spaces of four-dimensional instantons on singular varieties, 
but the formalism can be extended to smooth spaces as well and was indeed used in [33] . 



QXi = *i 



and 




(5.1) 
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To these fields we add the Fermi multiplet of antighosts and auxiliary fields (x, H ) associated 
with the equations £ = 0. Schematically, the bosonic part of the action contains a term 

S hos = i Tr £ • H + Tr H 2 , (5.2) 

which on-shell gives H = — ^ £ and S*bos = \ Tr £ 2 . Because of this, the multiplet (x,H) has 
the same quantum numbers as the equations £. Finally, one adds the gauge multiplet (0, 0, 77) 
necessary to close the BRST algebra, where <f> is the generator of gauge transformations which is 
related to the Higgs field $ of the noncommutative gauge theory via the decomposition (|4.14p . 
Their BRST transformations are given by 

Q<\> = , Q4> = 7] and Q77 = [</> , 4> ] . (5.3) 

We will split the set of equations £ into two sets (£ c = 0, £ r = 0) of complex and real equations, 
respectively, which play a role analogous to the F-term and D-term conditions. The latter condition 
can be regarded as a stability condition. 

We will also want to work equivariantly with respect to some toric action T d . Let us choose 
the rotations Xj — > X{ e~ lei for some parameters £j that generate the toric action. The BRST 
transformations are then modified to 



QXi = *i and Q^i = [</>, X t ] -e l X i , (5.4) 

where as usual the transformation of the fermions reflects the infinitesimal transformation of Xi 
under the symmetry group U(k) x T d . Let us consider now the Fermi multiplet (xc Xri H c , H r ) 
associated with the equations (£ c , £ r ). The equations £ c transform as an adjoint field under U(k) 
and as e 1£c under the toric action, where e c denotes some linear combination of the toric parameters 
€i that may be different for each equation. The second equation £ r again transforms in the adjoint 
representation of U(k) but is invariant under the toric action. These conditions determine the 
BRST transformation rules for the Fermi multiplets to be 

QXc,i = H Cji and QH Cji = [<j>, Xc,i] ~ e c ,i Xc,i , _ N 

(5.5) 

QXr = H r and QH r = [<ft,Xr] , 

where the label % runs over the set of equations of £ c . Finally, the gauge multiplet transforms again 
as in (j5.3f) . 

The action of the cohomological gauge theory can be represented as 

S = QTr (p[cf>, 0] -x-i + gx-H + Vi [X i: 0]) (5.6) 

and the path integral localizes onto the solutions of the equations £ = 0. Note that the path 
integral is independent of the coupling constant g, as usual in cohomological gauge theories. Let 
us now explicitly evaluate the path integral. The first step is to use the U{k) gauge invariance to 
diagonalize the gauge generator <j>. This produces a Vandermonde determinant det (ad (f>) in the 
path integral measure. Then one would like to integrate out the fields x, which appear quadratically 
in the action. However, this is not immediately possible. By looking at the BRST transformations 
(I5.5p we see that the mass matrix of Xr, Tr Xc • [</>, Xc], can have zero modes (while this is not the 
case for Xc if £c,i are generic). To cure this problem we add the term 

hQTrx^ (5.7) 
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to the action and take the limits t% — » oo and g —* oo with g <C ii. This is a legitimate procedure 
since the quantum field theory is topological and independent of t\. But in this way the resulting 
action has no kinetic term for the fermions, and so we add it by hand via the term 

t 2 QTr(X i ^l-Xj^ i ) . (5.8) 

Again this is legitimate since we are adding a BRST-exact term to the action and so the path 
integral will not change. 

We can now proceed in three steps: 



• Take the limit t\ — > oo. The relevant part of the action is 

t x Tr(H r + XrV) (5-9) 

and these fields can be trivially integrated out. This means that in the following expressions 
we can neglect them since their contributions to the path integral are suppressed in the 
t\ — > oo limit. 

• Now take the limit g —* oo. The relevant part of the action is quadratic in \ c (and in H c ). 
We can integrate them out and the result is a factor 

det(ad<£-e c ,i) (5.10) 

for each of the fields Xci- Note that we get a determinant and not its square root since Xc,i is a 
complex field. The determinant is in the numerator since the field Xc,i obeys Fermi statistics. 

• Finally, we take the limit t% — > oo and integrate out the fields Xi (and Vl/j) which now appear 
quadratically in the action. We obtain a factor 

1 

det(ad(^>- e;) ^ ' ' 

for each of the fields. Again we get determinants since Xi are complex fields, but now in the 
denominator since they are bosonic. 



We have dropped various normalization factors coming from the gaussian integrals that involve the 
couplings g, t\ and t 2 , which as expected cancel between the bosonic and fermionic integrations, 
and some ratio of the toric parameters ej which depends on the choice of equivariant action. It is 
important to remember that we still have the Cartan subalgebra integral over the diagonal field (j> 
left to do. 

When the equations are the ADHM-like or the DUY equations the resulting integral represents 
the instanton fluctuation factor in the charge k instanton sector. In this approach k is fixed and 
is the rank of the matrices Xj. The fluctuation determinant has the following structure. In the 
numerator there appear the Vandermonde determinant and a determinant due to the equations 
£ c = 0. In the denominator the factors are related to the fields Xi and reflect their quantum 
numbers. The determinant is of the form (constraint) /(fields) and this structure generalizes to any 
topological matrix quantum mechanics |42j . We will make extensive use of this in the followingo 

2 The Vandermonde determinant is not really a constraint but in a certain sense is related to the equation £ r = 0. 
Recall that it arises when one uses gauge invariance to diagonalize 4>. 
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5.2 Quiver matrix quantum mechanics 



We are now ready to systematically construct the topological quiver quantum mechanics of [12] 
and compute its path integral. We introduce two vector spaces V and W of complex dimensions 
dime V = k and dime W = N. In the noncommutative gauge theory the space V is an "internal" 
finite-dimensional subspace of the Fock module CK, represented geometrically by sheaf cohomology 
groups in (|4.72j) . while W is an "external" Chan-Paton space determined geometrically by framing 
data through the sheaf cohomology group f|4.88[> . In the quiver description they represent the 
spaces where the fields of the matrix quantum mechanics take values. In the D-brane picture V 
is spanned by the gas of k DO-branes, while W represents the TV (spectator) D6-branes. In this 
description we fix the topological sector and restrict attention to instantons of charge k. As in the 
previous sections we will keep the number N of D6-branes arbitrary for formal considerations, but 
concrete computations will require an explicit choice of gauge symmetry breaking pattern. 

The fields of the quiver are given by 

X, = {B u Bi,B z ,<p,r) , 

*i = (ipi,M3,t,p) • (5-12) 

The matrices Bi arise from 0-0 strings and represent the position of the coincident DO-branes 
inside the D6-branes. One may regard the fields (Bi,B2,B^,ip) as arising from the reduction to 
zero dimensions of the six-dimensional Yang-Mills multiplet (Z\, Z2,Z^,p). On the other hand, the 
field I describes open strings stretching from the D6-branes to the DO-branes and is characteristic 
of the quiver formalism. It characterizes the size and orientation of the DO-branes inside the DO- 
branes, and is required to make the system supersymmetric. Thus the bosonic fields are defined as 
linear maps 

(B 1 ,B 2 ,B 3 ,ip) G Rom(V,V) , 

I e Hom(W,V) . (5.13) 

The matrices Bi and I originate in the noncommutative gauge theory through the decompositions 
of the covariant coordinates (|4.5p and of the Higgs field (|4.14[) . As we will localize below onto the 
maximal torus of the U(N) gauge group, we can neglect the remaining fields J and K using fl4. 1 10[> . 

The fields Bi and ip all lie in the adjoint representation of U(k) where k is the number of 
DO-branes (or the instanton number). From the dimensional reduction, we can identify their 
transformation properties under the toric T 3 action as 

Bi .— > B t e~ i£i , 
ip i ► <p e -H*+t*+ea) . (5.14) 

We will frequently use the notation e = e% + €2 + £3 (with e = when we wish to make the Calabi- 
Yau condition (|3.9p explicit). On the other hand, I is a U(k) x U(N) bifundamental field where 
N is the number of D6-branes (or the rank of the six-dimensional gauge theory). Under the full 
symmetry group U(k) x U(N) x T 3 it transforms as 

I 1 — ► 9u(k)Ig ] u{N) e" 1£ • (5.15) 

The transformation of / under the toric action T 3 is not fixed by any constraint. In the following 
we will argue that e = (although the precise value of the toric parameter e is not important for 
the evaluation of the path integral). 
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The corresponding BRST transformations read 

QBi = tpi and Qipi = [(f), Bi] - e i B l , 

Qf = ( and Q( = [<fi,<p] — eip , (5.16) 

QI = p and Qp = <pl — la — el, 

where a = diag(ai, . . . , ajv) is a background field which parametrizes an element of the Cartan 
subalgebra u(l)® . In the noncommutative gauge theory on the D6-branes, a plays the role of the 
vev of the Higgs field /i( < I ) ), defined by a mapping analogous to (|4.18j) . In the present approach the 
fields a and 4> parametrize distinct D6 and DO brane gauge transformations. From (|5.16p it follows 
that they are only related to each other on-shell at the BRST fixed points. Figure [T] depicts the 
relevant fields that will enter into the quiver description of the Hilbert scheme below. 




Figure 1: Quiver description of the Hilbert scheme Hilb fc (C 3 ). 

For the bosonic fields we will consider the equations of motion 

Ei : [B i ,B j } + e ijk [Bl,i P ]=0 , 

3 

£ r : Yl [Bi,B\] + [tp,^]+II^ = r , 

i=l 

£/ : I j ip = 0. (5.17) 

The equations £j and £/ are relations for the quiver depicted in Fig. [Q while the equation £ r is 
a cyclic vector for the representation of the quiver in the moduli space of coherent sheaves. The 
Fayet-Iliopoulos parameter r > is determined by the noncommutative deformation of the original 
gauge theory and it determines the mass of the D0-D6 fields in terms of the asymptotic .B-field 
required to preserve supersymmetry in the D6-D0 bound states. 

The extra field cp and equation £/ can in fact be seen to arise from the extra moduli and matrix 
equations that we found in (|4.103|) - (I4.106I) . e.g. by identifying B[ = <pt. Its appearence there 
is natural since the projective space P 3 is not Calabi-Yau. They can also be seen to arise from 
the noncommutative instanton equations (|3.7p by decomposing the field p similarly to (|4.14p with 
cp G Endyi(J{® fe ). For the quiver matrix model appropriate to the dynamics on C 3 , however, one 
should set ip = and arrive at the system of matrix equations (|4.ip . These extra moduli can also 
play the role of the extra fields required when considers non-trivial asymptotic boundary conditions, 
such as those of f|4.38|) . as we do in the next section. 

We now have to add the Fermi multiplets (x, H ) , which contain the antighost and auxiliary 
fields x = (xii X2)X3)Xr-)£) and H = (H\,H2, H^,H r ,h). As we stressed earlier, the auxiliary fields 
are determined by the equations £ on-shell and so must carry the same quantum numbers. This 
implies that the antighosts are defined as maps 

(xi>X2,X3,Xr) 6 Hom(F, V) , 
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£ E Hom(V, W) , 



(5.18) 



since £ corresponds to the equation £/ which maps a vector in 1/ to a vector in W . 

Let us take a closer look at the defining equations (|5.17j) . As in Section [5J] above, the complex 
equations £j live in the adjoint representation of U(k) but transform under the toric action with a 
factor e -1 ( e-€i ). The real equation £ r lives in the adjoint representation of U(k) and is invariant 
under the toric action. Finally, the equation £/ transforms under U(k) x U(N) x T 3 as 

1*<P 1 — ► el(£ ~ e) 9U{N)I* 9u( k )9lHk)<P9u( k ) = e l{£ ~ e) 9U(N)I ] V9 ] u{k) ■ (5-19) 

We now have all the ingredients necessary to write down the BRST transformations for the remain- 
ing fields as 

QXi = Hi and QHi = [</>, Xi] - (e - £») Xi , 

QXr = H r and QH r = [<j>,Xr] , (5.20) 
Qi = h and Qh = a£-£0 + (e-e)f, 

to which we add the gauge multiplet to close the algebra (|5.3p . 

The action that corresponds to this system of fields and equations is given by 

S = QTr(xHH i -Z i ) + Xr(H r -E r )+£(h-£. I ) + ?p i [0, b\] 

+ C|>, ^] +p?I t +?7^,^] +h.c.) . (5.21) 



This action is topological and the path integral can be treated as we did in the Section f5.1l above. 
The critical points are determined by the zeroes of the BRST charge. We are interested in the class 
of minima where ip vanishes (and the fermions are set to zero). The fixed point equations are then 

( B i)ab (</>a -<t>b-H) = , 

I a ,i {4>a -ai-e) = (5.22) 

where we have diagonalized both (p (producing a Vandermonde determinant det(ad</>) in the path 
integral measure) and a by U(k) and U(N) gauge transformations, respectively. We will give a 
more precise classification of the fixed points in terms of three-dimensional partitions in Section \5. 31 
below. 

Regardless of what the structure of the fixed point set is, we can write down directly the 
fluctuation determinants with the general rules outlined in Section 15.11 above. The fields give 
a contribution in the denominator determined by their quantum numbers, while the constraints 
similarly appear in the numerator. The main difference from the noncommutative gauge theory is 
that now we have an additional field and an additional constraint. Putting everything together we 
get the partition function 



Z 



j n d & 



det (ad <f>) det (ad cp + e% + €2) det (ad (j) + t\ + £3) det (ad <f> + €2 + £3) 
det (ad <f> + e) det (ad <f> + e\) det (ad <p + €2) det (ad 4> + £3) 
det ( - 4> ® lw + lv ® a + (e - e)) 



det ((p (gi lw — ly ® a 



(5.23) 



where we have again dropped several factors including the volume of the gauge group. As in the 
noncommutative gauge theory, the ratio of determinants formally cancels up to a sign when e = 0. 
Thus the integration in (|5.23|) is ill-defined as a Lebesgue integral and must be defined via an 
appropriate contour integration. 
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At this point one should proceed to evaluate the integral of <f> over the Cartan subalgebra 
u(l)® fc . This is the main difference from the noncommutative gauge theory, even though the ratios 
of determinants formally look alike. In the noncommutative gauge theory the ratio of determinants 
is a function of only the equivariant parameters, since there we compute the determinants by 
taking products of eigenvalues of operators over the Hilbert space "K. Here things are different, as 
we are really dealing with a finite-dimensional k x k matrix model, and the ratio is a function of the 
eigenvalues of (p. The integral over the maximal torus of the group U(k) still has to be performed and 
it requires an appropriate prescription to pick an integration contour which encircles the relevant 
poles. Note that the fixed points of the toric action appear as poles in the denominator. The 
evaluation of (|5.23p by residues is in fact equivalent to the use of the localization formula applied 
to the equivariant Euler characteristic of the complex (|4.1U9j) . a fact that will be exploited in the 
following. 

It is amusing to note that the analogous problem was solved in four dimensions by lifting the 
theory to five dimensions (with the fifth dimension compactified), where a natural prescription for 
the contour integral can be found [42|, 143] . The rationale behind this procedure is that an instanton 
counting problem in four dimensions can be lifted to a soliton counting problem in five dimensions. 
It is tempting to speculate that the ratio of determinants in (|5.23j) (and in more general instances) 
may have a clearer origin in the context of topological M-theory on the product of a Calabi-Yau 
threefold with S . 



5.3 Fixed points and three-dimensional partitions 



We will now clarify how the matrix quantum mechanics equations (|5.22p can be solved in terms 
of plane partitions. We will focus on the abelian case where the parametrization of the Hilbert 
scheme allows for an explicit classification of the fixed points. In this framework we can show 
explicitly how the melting crystal picture is encoded in the matrix model formalism and thus how 
the gravitational quantum foam emerges naturally from the gauge theory variables. The following 
analysis is a generalization of the arguments of [34] . We will go through the argument in two steps. 
First we will recover the Hilbert scheme of points by the matrix quantum mechanics equations of 
motion. Then we will show how to construct a three-dimensional partition given a fixed point in 
the Hilbert scheme and viceversa. 



Consider the Hilbert scheme of k points in C 3 given by 



Hilb* 



Then we claim that 



{ideals J C C[Bx, B 2 , B 3 ] | dim c C[B 1 ,B 2 ,B 3 ]p = k} 



(5.24) 



Hilb* 



(Bi,B 2 ,B 3 ,I) 



[B U B 2 ] = [B^Bs] = [B 2 ,B 3 ]=0 
Stability: there is no proper 
subspace S C C k such that 
Bi{S) C S and im(I) C S 



GL(k,i 



(5.25) 



where B< 6 End(C fc ) and I 6 Hom(C,C fc ). In the quiver language one has C = W and C fe = V. 
The action of the gauge group GL(k,C) is given in (|4.2|) . 

The correspondence can be seen as follows. Suppose we are given an ideal J G Hilb fc (C 3 ). 
Then we can define V = C[B\, B 2 , B 3 ]/3, and Bi £ End(F) to be given as multiplication by Bi 
mod 3 and / £ Hom(C, V) by 1(1) = 1 mod J. Then all the Bi commute since they are realized 
as multiplication and the stability condition holds since products of the B^s times 1 span the 
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whole of the polynomial ring C[Bi, B 2 ,B 3 ]. Conversely, suppose we are given a quadruple of maps 
(B\ , B 2 , -B3 , 1)- We introduce the map 

li : C[B U B 2 ,B 3 ] — > C fc 

/ f(B 1 ,B 2 ,B 3 )I(l) (5.26) 

which is well-defined since the -Bj's commute. Consider now the subspace im(/x) C C fc . This 
subspace is ^-invariant since it is the subspace spanned by the Bi themselves and im(J) C im(/i). 
Then the stability condition implies im(/z) = C fc . This means that the map fi is surjective. Then 
J := ker/i is an ideal with dime C[B\, B 2 , Bs]/3 = k. Explicitly, one has 

J = {/(*) G C3 C[B U B 2 ,B 3 ] I /(Si, B 2 ,B 3 )I(1) = 0} . (5.27) 

This ideal is isomorphic to the rank one cohomology sheaf (|4.77|) . By restricting the complex 
(j4"776j) with N = 1 to C 3 = P 3 \ P 2 as before, the image of (147771) in C 3 induced by the localized 
maps a z and b z with J = K = 0, and suitable matrix identifications in Section 14.61 is precisely 
the ideal (I5.27|) . The proof parallels |341 Proposition 2.7]. As an explicit example, the charge 2 
abelian instanton moduli space is Mi^C 3 ) = C 3 x 0p2(— 1), where the first factor is the space 
of 2 x 2 matrices (B\, B 2 , B3) which parametrize the center of mass of the instantons, while the 
second factor is the resolution of the relative position singularity at the origin which gives the size 
and orientation of the instanton configuration. 

We have thus constructed an explicit correspondence between elements of the Hilbert scheme 
and commuting matrices (with a stability condition) which correspond to the quiver quantum 
mechanics. We will now consider a fixed point and show that it can be parametrized by a three- 
dimensional partition. We consider a torus T 3 acting on C 3 with generators (t\, t 2 ,ts). This action 
lifts to the Hilbert scheme. A fixed point given by {B\, B 2 ,B%, I) is characterized by the condition 
that an equivariant rotation is equivalent to a gauge transformation 

t 1 B 1 = gB 1 g- 1 , 

t 2 B 2 = gB 2 g~ 1 , 

t 3 B 3 = gB z g~ x , 

I = gl (5.28) 

with g S GL(k,C). We use the weight decomposition 

V = V(i-l,j-l,k-l) (5.29) 

with 

V(i- l,k- 1) = {v € V I g~ l v = t\- 1 t> 2 - 1 t*- 1 v} . (5.30) 

The notation has been chosen such that V(0, 0, 0) denotes the subspace spanned by gauge-invariant 
vectors. 

Consider a generic triple of integers (i,j,k). According to the definition (I5,30p the only non- 
vanishing components of the maps (B\, B 2 , B3, 1) with respect to the splitting (|5.29p are given 
by 

B x : V(i,j,k) — V(i-l,j,k) , 
B 2 : V(i,j,k) — » V{i,j-l,k) , 
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B 3 : V(i,j,k) — V(i,j,k-1) , 



I : W — ► F (0,0,0) . (5.31) 

This can be seen as follows. By the stability condition the vector space V is spanned by elements 
of the form Bf B\ B™ 1(1) with p,q,m 6 No- In particular, the subspace V(0,0, 0) is spanned by 
1(1) and is one-dimensional. Consider now acting on the vector 1(1) that generates this space with, 
say, B\. This gives the vector B\I(1). Now we see that 

g- 1 (#i/(l)) = g- 1 B x gg- 1 1(1) = tj 1 B 1 1(1) (5.32) 

due to (|5.28p . This means that B\I(1) G V(— 1,0,0). The more general cases in (|5.3ip are treated 
similarly. 

To make contact with the fixed point equation we parametrize the gauge group by the k x k 
matrix <p and diagonalize it at the fixed points. We also write U = e~ lei . The defining equation 
in (|5.30p can be satisfied by picking the k eigenvalues of <f> and setting them equal to 

4>(i,j,k);i = ai + ei (i - 1) + e 2 (j - 1) + e 3 (k - 1) . (5.33) 

Using (|5.3ip . this reproduces the expected result from (|5.22p . Then this weight decomposition of 
the vector space V is equivalent to the classification of the fixed points as done in the previous 
sections. At each fixed point the eigenvalues of 4> are determined by the weights of the toric action. 
Following [33] we will now see how the definition (|5.30p implies that the allowed values of (f> (i.e. 
the allowed non-trivial spaces V(i — l,j — 1, k — 1)) are in correspondence with plane partitions. 

We note that V(i,j, k) = if one of (i,j, k) is strictly positive. Only negative or zero values are 
allowed. If we generalize this reasoning to vectors of the form Bfl(l) we conclude that 

dim c V(i, 0,0) > dime V(i - 1, 0, 0) , 
dim c y(0,j,0) > dim c y(0,i-l,0) , 

dim c V(0,0, k) > dim c V(0, 0, k - 1) , (5.34) 

and that these dimensions can only be either zero or one. Intuitively, we are "constructing" the 
exterior boxes of the three-dimensional partition and each box is represented by a non-trivial vector 
space. Now we will go to the boxes in the interior by using the commutativity relations [Bi, Bj] = 0. 
We will proceed by induction. 

The commutativity relation [B\,B2] = ensures that the configurations 

V(i,j-l,k)^C-^-V(i-l,j-l,k)^0 (5.35) 

V(i,j,k)^C -0 

and 

*-V(i-l,j-l,k)^0 (5.36) 

B 2 

v(i,j,k)^c — ->y(i-i l j 1 ^c 
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are impossible, where the notation V(i,j, k) = C stands for the assumption that these spaces are 
one-dimensional. On the other hand, the diagram 



V(i,j-l,k)^C-^*-V(i-l,j-l,k) 



B 2 

V(i,j,k)^C- 



(5.37) 



B-2 



-V(i-l,j,k)^C 



implies that V(i — 1, j — l,k) has dimension or 1. We can think of B\ and B2 as the "directions" 
of the base of the three-dimensional partitions. Then these conditions tell us that the base is a 
usual Young tableau oriented as in [3l] . 

Now we have to put boxes on top of this "base" Young tableau. What are the allowed configu- 
rations? The equation [i?i,i?3] = implies that the two diagrams 



V(i,j,k-1) 

B 3 

V(i,j,k) * 



Xv(i-l,j,k-l)^0 



(5.38) 



and 



B 3 



V(i,j,k)<*C -+v(i-l,j,k) 



(5.39) 



are forbidden. Again the commutativity of 



Bi 



V(i,j,k-l)^C^^V(i-l,j,k-l) 



Bz 

V(i,j,k)^C- 



(5.40) 



B 3 



Si 



■V(i-l,j,k)^C 



implies that dime V(i — 1, j, fc — 1) is either 1 or 0. Finally, the equation [.62,-63] = forbids the 
two configurations 



V(i,j,k-1)^( 

B 3 

V(i,j,k)^C- 



B 2 



V(i,j-l,k-l) 



(5.41) 



and 



-V(i,j -l,k- 1)^0 

B 3 



(5.42) 



V(i,j,k)=C -+V(i,j-l,k) 



while the commutativity of 



V(i,j,k-1)^( 

B 3 

V(i,j,k)^C- 



B-2 



B-, 



~V(i,j -l,k-l) 

B 3 

-V(i,j -l,k) = C 



(5.43) 
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implies that dime V(i, j — 1, k — 1) is either 1 or 0. 

By induction this implies that each vector space V(i,j, k) in (|5.29p is either one-dimensional or 
zero-dimensional. Moreover, the allowed configurations correspond to three-dimensional partitions 
where we put each box in the position of a one-dimensional vector space. For example, we can 
construct the partition starting from a two-dimensional Young tableau lying on the plane (B\, B2). 
On top of each position (i, j) corresponding to a box of the tableau we put boxes. The diagrams 
above corresponding to the equations [Bi,B^\ = [.62,-63] = tell us that we can pile the boxes 
only in the "correct" way, so that 

7Ti,j > Ki+rj+s for r, s > (5.44) 

with k = Yli j<Q n i,j- Pictorially, the diagram 

V(0,0,-2) i-V(Q-l,-2) (5.45) 



v(o,o -1) ^v(o-i-i) 




V(0 -3,0) 



V(-2,0,0) 

is a simple plane partition. Note that one has to specify from the beginning which vector spaces 
are non-trivial in order to get a partition. 

This construction easily generalizes to the nonabelian theory in the broken phase U(1) N . In this 
situation we can assume that the relevant moduli space splits into a direct sum of sectors labeled by 
the Higgs vevs ai, each one essentially identical to the Hilbert scheme of points. Consequently, the 
classification above of the fixed points can be easily generalized by simply adding a label ai (colour) 
to each vector space, V ai (i,j, k). This agrees with the classification suggested in [IT], while in [12] 
the equations of the topological matrix model have been interpreted in terms of skew partitions 
with N "corners" on the interior boundary. In the string picture this corresponds to a situation 
in which the N D6-branes are well separated in the transverse space. The DO-brane bound states 
with each of the D6-branes give N copies of the melting crystal configuration. 

Note that in this framework the role played by I (representing the 0-6 open strings) is to simply 
label the colour of the three-dimensional partition. In our approach we use the N non-trivial com- 
ponents 1(1) (0,0,0);/ labelled by the Higgs vevs a/ to build ./V individual three-dimensional partitions. 
Notice also that the k non-vanishing components of Bi and 7 at a fixed point, corresponding to 
the number of boxes of the associated three-dimensional Young diagram, are fixed completely by 
the matrix equations (|4.1|) . This follows from the fact that the matrices in the last equation of 
(14. 1|) (the D-term constraint) are all A; X A; and the diagonal components yield exactly k constraints. 
Thus the fixed points are indeed isolated. 

Geometrically, these coloured partitions can be understood as fixed points in the framed moduli 
space (|4.19p as follows. There is a natural action of the torus T 3 x U (l) N on M/vr,fc(P 3 ) induced by 
the T 3 -action on the toric manifold P 3 and the action of the maximal torus U(1) N on W <8> On , 
i = 1,2,3, where W = Wi decomposes into irreducible representations Wi = C of U(l). Then 
the T 3 xU(l) N fixed points on Mat^P 3 ) are the coherent, torus invariant sheaves £^ = J ai ©- • -©^at 
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with pointlike support Z = Z ai U • • • U Z aN at the origin of C 3 , where 3 ai is a T 3 -invariant ideal 
sheaf supported on the T 3 -fixed zero-dimensional subscheme Z ai C C 3 = P 3 \ with the framing 
J ai |^ = Wj ® O^i . In particular, the weight decomposition (|5.29l) coincides with H°(Oz)- 

5.4 Quiver variety for Donaldson-Thomas data 

At this stage we have provided a classification of the critical points in the abelian theory that can 
be easily generalized to the £7(1) picture. To complete the localization program we have to now 
compute the quantum fluctuation factor around each critical point. This can be done explicitly in 
our ADHM-type formalism since it provides a direct parametrization of the compactified instanton 
moduli space. The heuristic structure of "fields" and "constraints" that we have exploited above 
to write down the ratio of determinants in (I5.23|) can be made precise in terms of an equivariant 
index that counts BPS states. Geometrically, we will provide a description of the (virtual) tangent 
space around each fixed point (the "fields"), and on top of it we build the normal bundle (the 
"constraints" ) . This finally gives the last missing piece of information needed to use the localization 
formula. We will assume that the gauge symmetry is broken down to the maximal torus U(1) N 
and recover the abelian theory as a particular case. 

Recall that in the quiver description above the two vector spaces V and W with dime V = k 
and dime W = N represent respectively the gas of k DO-branes and the N D6-branes. Naively, 
the bosonic fields are elements (|5.13p . while the fermionic fields associated with the equations 
of motion live in (|5.18j) . However, this is not really what we need since we have to compute 
contributions coming from the fixed points and each fixed point is characterized by the fact that 
the equivariant transformation mixes with the linear transformations of the vector spaces V and 
W. To make this apparent we introduce a three-dimensional T 3 -module Q that acts on V. At a 
fixed point / G M we have to supplement the conditions (|5.13f) and (|5.18p with the information 
that a gauge transformation is equivalent to an equivariant rotation. Let us take the three-torus 
to be T 3 = (ti = e lei ,t2 = e 1<E2 ,i3 = e 1£3 ), and introduce the following notation. Tj is the 
one-dimensional module generated by ti, TiTj is generated by titj and T\ T2 T3 by ^£2^3, and 
similarly for the dual modules T* := Tf . We write Ei for the module over T 3 x U(1) N generated 
by e\ = e 10,1 . For brevity we omit tensor product symbols between the T-modules. 

With this notation, at the fixed points of the T 3 x U (1) action, which correspond from above 
to coloured partitions tt = (wi, . . . , ttn), we decompose the vector spaces 

N 

1=1 (i,j,k)eni 
N 

= (5.46) 
1=1 

as T 3 x U (1) N representations viewed as polynomials in t\, t2, t% and ei, I = 1, . . . , N. For each I, the 
sum over boxes of 717 in Vj? is the trace of the T 3 -action (i.e. the T 3 -character) on C[B\, B2, B^[/"3 ai . 
Taking into account the action of the torus on the vector space V we can write 

B x e Hom(y Tf , Va) Tf 1 , 
B 2 G Hom(V #J V*) T 2 X , 
B 3 G Hom(V5 ?J V#) ® T3- 1 , 

ip g Hornet, va) ® {n^nr 1 , 
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/ G Hom(W # , Vg) . (5.47) 

It is important to stress that these decompositions only hold at the fixed points and not generically 
on the instanton moduli space. We have chosen / as before to be invariant under the toric action. 
This amounts to setting e = 0, which we will see later on is consistent with the known abelian case. 
Similarly for the constraints (again at the fixed points) 



Xi 


g 


Hom(^, Vjf) 




X2 


G 


Hom(^, V*) 


®T 1 - 1 T 3 - 1 , 


X3 


G 


Hom(^, V*) 


®T 2 - 1 T 3 - 1 , 


Xr 


G 


HomCVjf, Vjf) 


J 


C 


G 


Hom(^, 


)<8r _ lr _ lr _ 



(5.48) 

We will call an element 

{B u B 2 ,B 3 ,(p,I) G (Q®Hom(V,V)) © {/\ 3 Q® Hom(V, 1/)) © Hom(W,F) (5.49) 
a Donaldson-Thomas datum, where 

Q = T^+T^+T^ 1 , 
A 2 Q = Tf 1 T 2 l + Tf 1 T3- 1 + T 2 l T3- 1 , 

A 3 Q = detQ = T{ l T 2 l T^ x . (5.50) 

Recall that there is a natural GL(k, C) action on this data. If we impose the stability condition 
on (|5.49|) . then this group action is free. Then we may define the geometric invariant theory 
quotient of the subspace of (|5.49[> given by /x~ 1 (0)// GL(k,C), where fi c = (£j, £/) is a complex 
moment map. This is the quiver variety for Donaldson-Thomas data. This can also presumably 
be defined by relaxing stability and taking instead a hyper-Kahler quotient of the data (|5.49p given 
by /x~ x (0) n ^(r)// U(k), where real moment map. However, like the other moduli 

spaces considered in this paper, we are not aware of any scheme (or stack) construction on this set. 
Our calculations below suggest that there is an isomorphism Mj^jv — Me (0) H /i r T 1 (r)// U(k) with 
the moduli space of framed, stable coherent sheaves (14.191) . 

5. 5 Localization formula and character 

Let (B\, B2, .63, tp, I) be a Donaldon-Thomas datum corresponding to the fixed point tt. Let us 
study the local geometry of the instanton moduli space around this fixed point. Consider the 
complex 

Hom(y 7f ,l/ 7f ) © Q 

© Hom(^, Vjf) © A 2 Q 

Hom(Vff,V^) Hom(W*,V*) — © (5.51) 



Hom(1^, V^) © A 3 Q 
The map cr is an infinitesimal (complex) gauge transformation 



a(cf>) 



(4>Bi 


~B 1 <A 


<PB 2 


-B 2 4> 




-B 3 


41 


-la 


\ 0V 


-v<t> J 



(5.52) 
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while the map r is the differential of the equations that define the moduli space [Bi, Bj] 
by 



given 



Y 2 
Y 3 
s 

w 



f[B 1 ,Y 2 ] + {Y l ,B 2 ]\ 
[Bx,Y 3 ] + [Yx,B 3 
[B 2 ,Y 3 ] + [Y 2 ,B 3 

\ s t + jt y 4 / 



(5.53) 



where one can think of Y{ as <5-Bj and so on. 



The complex (I5.5ip is the matrix quantum mechanics analog of the instanton deformation 
complex (|2.3|) , In a similar way, its first cohomology is a local model of the Zariski tangent space 
to the moduli space, while its second cohomology parametrizes obstructions. This is exactly the 
information we need to integrate (|2.4p . We conjecture, along the lines implied in Section T5.4I above, 
that this integral reproduces the localization of a virtual cycle on the geometric moduli space (I4.19p . 

We want to apply the Duistermaat-Heckman localization formula (|2.10p . or better its super- 
symmetric generalizations |40| . to the integral (12. 4p . This involves the ratio of the top Chern class 
of the obstruction bundle over the weights coming from the tangent space. For what concerns 
the computation of the Chern classes we can decompose the tangent and normal bundles over the 
moduli space as Whitney sums of line bundles by using the splitting principle as TM = ® i £j and 
Ji = i Qj. Accordingly, the equivariant Chern polynomials are given by 



z(TM) = Yl (c^i) + Wi [TM]) , 
i=i 

n 



(5.54) 



i=l 



where the local weights Wi in general depend on the toric parameters (ex, e 2 , 63, a). The same 
information is contained in the equivariant Chern characters 



ch(TM) = e 



i=X 
n 



=h(X) = e 



ci(£,<)+iUi[TM| 



cl (Qi)+wim 



(5.55) 



The Chern classes of the line bundles do not contribute to the localization formula since they 
have to be evaluated at a point (and the critical points are isolated). Then we can use directly the 
above expansions to extract the relevant weights to be used in the localization formula. In practise 
this is accomplished via the transform pH HO] 

n n 

Y^ni e w ' ■— » J]>r • (5-56) 

i=l i=i 

This means that all the relevant data that enter in the localization formula are already contained 
in the equivariant index of the complex (|5.51|) . To be precise the index computes the virtual sum 
H 1 QH QH 2 of cohomology groups. We assume that H vanishes, which is equivalent to restricting 
attention to irreducible connections. Using ([5.56p we see then that the equivariant index computes 
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exactly the inverse of the ratio of the weights that enter in the localization formula. The equivariant 
index is given in terms of the characters of the representation evaluated at the fixed point as 

Xff (C 3 ) [k] = Vi ® V* ® (Tf 1 + T 2 X + Tg- 1 + Tf 1 T 2 X T^ 1 ) +Wt®V$ 

-V2 (8) <g> (1 + Tf 1 Tf 1 + Tf 1 Tf 1 + Tf 1 Tf x ) - VZ ®Wf® Tf 1 Tf 1 Tg" 1 

_ ^.V,-S^ + V?.V,fizM^)(iZ«. (5.57) 

tl t2 13 tl £2 £3 

In the abelian case, W = C and we can formally set W = 1. Then the character (|5.57p 
reproduces exactly the vertex character computed in [7J. It is not clear what is the precise relation 
of the above construction with the more geometric approach of [7J, since in the gauge theory picture 
there are several matter fields which do not figure into the computations of [7j. Nevertheless, it 
is reassuring that we can reproduce the result of [7j without resorting to the evaluation of virtual 
fundamental classes but only with arguments well rooted in our physical intuition. It would be 
very interesting to understand in the language of [7J what the meaning is of the vector space W. 
A final remark about the equivariant transformation of /, i.e. the choice e = 0. This can be now 
justified since it is the choice that reproduces the abelian character. 

From this discussion we can immediately write down the partition function 

Z^ )N {C 3 )=Y,Z* e 1 *!*! , (5.58) 

7? 

where is what the matrix integral f|5.23j) computes and is given by (|5.57p through the rule 
(|5.56p . However, its explicit form is not very illuminating. To obtain a more manageable form let 
us simplify the character a bit. We begin by looking at the abelian theory with N = 1. Then 

X„ab (C 3 ) W = V* - + K ® V* (l^mzm^ (5.59) 



where at a fixed point 

One can easily see that 
where 



Kr= E tirH^it 1 ' ( 5 - 6 °) 

^,ab(C 3 ) [fcl =T+ + T; (5.61) 
(l-* 2 ) 



t+ = v n -v n ®v: 



h t 2 



t; = -rf r + K^; (1 " tl ! ( !" t2) . (5.62) 

tl t2 £3 £l £2 £3 

With the dual operation t ^ t* = £ _1 , this splitting of the character has the remarkable property 

( T ^) 1*1*2*3 = 1 = _ T ^ lil *2 *3 = i • ( 5 - 63 ) 

Note that this property is true only when one imposes the Calabi-Yau condition t\ £2 £3 = 1- 

What is remarkable about the property (|5.63p is that due to (|5.56|) the contribution to the 
full fluctuation determinant is a minus sign to some power and this power can be computed to be 
T+(£i = £2 = £3 = 1). Explicitly, one has 

y Jc 3 V fc] ! = T+! + T - I 

XTT,ab^ ) | tltat3=1 7T \ tl t 2 t 3 = l ^ T \t 1 t 2 t 3 = l 
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T+l -fT+VI 

""1*1*2*3=1 V 1*1*2*3=1 
n n 
^ n . e «<[ei,ea,e3] _ n . e _ ( 5 64 ) 



j=l i=l 
By using the transform (|5.56p we can write the contribution to the partition function as 

Tl r -l ■ 

= n ? Wi[ T C2,C3] 1 U = n = ^ ni > ( s - 65 ) 

(-«;<[€!, e 2 ,c 3 ]) f = \ 

and the sum over the multiplicities rij can be obtained by taking T^"^ ^ and setting the weights 
u>i to zero, i.e. setting e, to zero or ij to one. It is easy to see that T+(ii = £2 = ^3 = 1) = |vr| since 
the second term of T+ in (|5.62|) vanishes at tj = 1. Thus we conclude that the partition function 
in this case is given by 

Zg«(C 3 ) = J^(-1)M e i,? W , (5.66) 

which reproduces the MacMahon function (|3.50p with the usual redefinition — e 11? = e _9s = q. 

These arguments carry over to the U(1) N theory with only minor modifications. Now we have 
to consider the full character (|5.57p . The splitting 

t+ = v^w;-v^v: (i-frH 1 -^ , 

TZ = -qe^ + y^V-W-V (5.67) 

ht 2 t 3 71 ht 2 t 3 K J 

is helpful in simplifying the computation. At the fixed points n the vector spaces V and W 
decompose as in (15.46)) . The property (|5.63l) still holds but now the dual involution is defined as 
(ei) ^2, £3, o) l— ► (— ei, — £2, —£3, —a). By a similar argument as above we need only evaluate Tt at 
(eij e2, £3, a) = (0, 0, 0, 0). The second term in (I5.67P again drops out and the first one gives 

N N N 

£ £ £ i = *£w- (s.es) 

i=l i'=l (i,j,k)£-K t , l'=l 



To complete the computation of the partition function, the only missing ingredient now is the 
instanton action. Analogously to |36) I43| . we write the universal sheaf £ on the moduli space 
M^ fc (P 3 ) as 

E = W © V® (5- QS+) (5.69) 

where are the positive/negative chirality spinor bundles over P 3 , localized at a point of the 
fibre of C 3 = P 3 /P 2 . At a critical point 7r we regard ()5.69j) as a virtual T 3 x U (1) N representation. 
By using the correspondence between spinors and differential forms given by twisting the spinor 
bundles to get S ± tfg*/°M>° [20], we can derive the Chern character 

ch(£ ff ) = W 7 ? + (t 1 + t2 + t 3 + t 1 t 2 t 3 -l-t 1 t2-t 2 t 3 -t 1 t 3 )V 7 ? 

= W^-(l-ti)(l-i 2 )(l-t3)^. (5.70) 

In the quiver formalism we work in an instanton sector with fixed charge k = dime V# (so that the 
instanton action is proportional to k), and this corresponds to the total number of boxes of the 
partition by the same arguments used in the classification of the fixed points. Each subspace in 
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the weight decomposition of the vector space Vjf is one-dimensional and corresponds to a box in 
the partition tt. The generating function for the nonabelian invariants is thus 

Z^ )iV (C 3 ) =J2(~l) NWl , (5.71) 

7? 

which coincides with eq. (|3.ip . 

5.6 Comparison with the noncommutative gauge theory 

The results described in this section have a clear interpretation in terms of the noncommutative 
gauge theory of Section [3] that was spelled out in detail in Section [H We can formally take this 
a step further and stress some close similarities between the two approaches. Recall that for 
the classification of the fixed points in the noncommutative gauge theory one simply needs to 
construct the Hilbert space on which the noncommutative algebra A is represented. In particular, 
the ratio of fluctuation determinants has the same structure, the main difference being that in 
the noncommutative gauge theory we are dealing with the determinants of operators acting on 
a separable Hilbert space which gives directly the result, while in the matrix model after the 
computation of the determinants there is still the integral over the Cartan subalgebra to do. The 
evaluation of the contour integral (|5.23p was finally sidestepped by constructing an explicit local 
model for the instanton moduli space. The computation of the associated index is equivalent to a 
direct use of the localization formula. 

We can build a formal dictionary to go back and forth between the two approaches. This 
could prove very helpful in extending our general formalism to other setups. The equivariant 
Chern character (|5.70p can be derived precisely in the noncommutative gauge theory. If we use the 
notation 

Xo(t) := ch*(t) =W#-(1- e* ei ) (1 - e te2 ) (l - e te3 ) V 9 (5.72) 

along with the redefinitions t%= e tei and e\ = e ta ' , then the integrand of (|3.4ip formally reproduces 
the character (15.570 up to the perturbative contribution <8> W5 and an irrelevant overall sign. 
The sign mismatch was explained above in terms of the alternating sign in the definition of the 
index. The role of the exponentiation and of the integral over t is to reproduce the transform 
(|5.56p . Altogether, we can take this as a rule to compute the equivariant index from the ratio of 
fluctuation determinants as computed in the noncommutative gauge theory. This is perhaps not 
surprising as field theoretically both approaches are just two different ways to handle the ill-defined 
localization in the original cohomological gauge theory. An application of this formalism will be 
presented in the next section where we compute the partition function of the U(1) N model on a 
generic toric Calabi-Yau manifold. 

6 Partition function on a toric manifold 

In the previous sections we have derived a precise dictionary between the noncommutative gauge 
theory and an auxiliary matrix quantum mechanics. We will now apply our formalism in a controlled 
setup, switching between the two approaches when convenient. In particular, we will write down the 
partition function of the U(1) N gauge theory on an arbitrary toric Calabi-Yau threefold, extending 
the gauge theory prescription of [8] for handling the instanton counting on a generic toric manifold 
and the geometric results of |7J to compute the quantum fluctuation determinants. Although our 
final result does not provide any new geometrical invariants of threefolds, as it does not capture 
the full nonabelian structure of the Donaldson-Thomas invariants, it does compute the number of 
BPS bound states of branes in this specific regime of the theory. 
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6.1 Instanton action 



Let X be a nonsingular toric threefold with Kahler two- form ko and Newton polyhedron A(X), the 
image of X under the moment map associated to the toric action on X. The vertices / of A(X) 
correspond to the fixed points of the T 3 -action on X. For each / there is a T 3 -invariant open C 3 
chart centred at the fixed point. On each patch we can choose coordinates corresponding to the 
directions (ti,t2,ts), where (ti ,^2,^3) = (e 1£1 , e 1<E2 , e 163 ) are the generators of the toric action. 
The edges of the polyhedron A(X) correspond to the T 3 -invariant lines of X. They represent 
generic projective lines P 1 which join two fixed points f\ and f 2 in A(X). Instantons of U(N) 
noncommutative gauge theory on each C 3 patch in the Coulomb phase correspond to sums of 
monomial ideals Jf = J 0l f ffi • • • © J ajv f in C 3 associated to coloured three-dimensional partitions 
ttj = (iri f, . . . , ttatj). Such collections of ideals correspond globally to T 3 x L r (l) Ar -invariant torsion 
free sheaves £ of rank N on X with associated subscheme Z supported on the fixed points in A(X) 
and the lines connecting them, together with a framing £00 = W <8> Ox- 

We need to compute T r CK 3/ ( e **)> where $ is a nonabelian Higgs field and the Hilbert space 
l Kj f corresponds to a three-dimensional partition ttj with fixed asymptotic behaviour at infinity. 
One can write down directly the Chern character at a fixed point / £ A(X) corresponding to the 
generalized instanton configuration with fixed asymptotics as 

N 

X3 f (t) = Y,eu(i-(i-h)(i-t 2 ) e ^"'-(i-fcKi-ts) E ^r 1 ^ -1 

- (1 - t 2 ) (1 - t 3 ) £ iP- l tt~ l 

(j,fc)£Ai,i,/ 

- (1 - h) (1 - 1 2 ) (1 - 1 3 ) E 4' 1 ■ (6.1) 

(i,j,k)ETTlJ 

The first set of terms represent the vacuum contribution which is fixed asymptotically by the 
3N two-dimensional Young tableaux (Xi ij, ^3,z,/)j the asymptotics of 7T;j in the coordinate 
directions labelling the corresponding edges emanating from the vertex /. We are covering the 
toric manifold X with C 3 patches and solving the noncommutative gauge theory in each patch. 
The asymptotic boundary conditions are necessary to glue the patches together. The ordinary 
two-dimensional partition which is the asymptotic condition in the i-th direction t{ is denoted by 
Xi,l,f, with the index / = 1, . .. ,N reminding us from which sector of the Hilbert space 'K^ f they 
come from. The last term corresponds to the three-dimensional partitions itij which should now 
be understood as properly renormalized for n>0 with volume 

k/l = ( E 1 ) - + 1) (I V/l + Wi,f\ + \h,l,f\) ■ (6.2) 
(i,j,fc)e7r ii/ 

i,j,k<n 



In the following we will impose the Calabi-Yau condition (|3.9|) and define x = The equiv- 
ariant parameters are defined differently in each C 3 patch and in such a way that they match when 
gluing the patches together as in the topological vertex gluing rules. The contribution of the third 
Chern character to the instanton action, i.e. the coefficient Xj °f ^ 3 i n t ne small t expansion of 
dSHD , gives 



N 

/ Tr Fa A Fa A Fa = E Ev r m - ! 

487T 3 x ^-^ ^-^ \ oei t xt (1 + xt) ^-^ 
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where we have written down explicitly the sum over fixed points / associated with the vertices of the 
toric diagram A(X). Each vertex contribution has a proper factor associated with the vertex itself, 
but it also comes with edge factors associated with the asymptotic two-dimensional partitions. To 
properly treat the edge factors one has to consider both contributions associated to an edge coming 
from the two adjacent vertices. This will be done explicitly in the following. 

The first contribution in (|6.3|) is independent of the partitions iff, and as such can be factored 
out as a "perturbative" contribution as before. The second contribution gives a factor of \ttj\ 
associated to each vertex of the toric diagram and generalizes the instanton action. The remaining 
three terms come from the contribution of the asymptotics and have to be combined with the 
analogous contributions coming from other fixed points. For example, let us choose a fixed point / 
and consider the term where we sum over boxes of ^3,ij- The vertex we are considering is joined 
to another vertex along an edge and the partitions on the edge have the structure given by ^3,1 j ■ 
The edge represents a T 3 -invariant rational curve P 1 with normal bundle (Dpi (—mi) © Opi(— 777.2) 
determining the local geometry of A(X) near the edge. The Calabi-Yau condition implies 

mi + ??i2 = 2 . (6-4) 

The two contributions we have to consider are exactly the same but each one is expressed in terms 
of the equivariant parameters that are associated with the local coordinates in each C 3 patch. The 
relation between the equivariant parameters is then given by the transition function between the 
two coordinate charts as [7] 

ei,/ 2 = e l,/i + m i e 3,/i > 
£2,/ 2 = £2,/! + m 2 e 3Jl , 
£ 3,/ 2 = - £ 3,/i , 

€\j 2 1 — mi — mi Xf L 

where f 2 ) labels the two fixed points joined by the edge. 
After a bit of algebra we find 

N , 

1 , • , 1 - J , a hh 1 , • , 1 ~ 3 . a i,h 



1=1 

N 



y y -- + j+ h ~ J + ^ - + j+ L ~ J + 



^2 ^2 (-l + 2j + imi - jmi) 
1=1 (ij')6A 3ii>/l 



N 



= 2 Yl (mi(i-l)+m 2 (j-l) + l) (6.6) 

1=1 (itfeXaMt 

where in the last equality we have used (|6.4p to express the edge contribution in a universal form. 
The Higgs vevs cancel since we require 0/ j 1 = aij 2 as part of the gluing conditions^ and the edge 

3 Each at j gives the asymptotic boundary condition on the instanton labelled by /, and we can glue together two 
instantons at infinity if and only if they have the same value of aij. 
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contribution along the "direction" t 3 is the sum of ./V terms which all have the same form as in the 
abelian N = 1 theory. After performing similar computations along the other two "directions" t 2 
and t\, the cli3 term of the instanton action gives 

N N 

'(*/)= E EK/I+ E E E (mx, e (i-l)+m 2 , e (j-l) + l) , (6.7) 
feA(x) 1=1 eeA(x) 1=1 {i,j)e\ l>e 

where the sum over / runs through the vertices of the toric diagram A (A) while the sum over e 
runs through the edges. 

To complete the evaluation of the instanton action one needs to also consider the second Chern 
character, i.e. the coefficient Xj °f ^ m t ne small t expansion of (|6,ip . One finds 

i r ^ H fxf ] 

-—2 / ko A Tr Fa A Fa = V (6.8) 

- \ ~* ( a ^f — _ \ ^ Hf ^ \ - Hf ^ \ - Hf 

where -ffy is the value at the fixed point / of the hamiltonian H associated with the vector field f2 
that generates the equivariant rotations, i.e., dH = inko- The term depending on the Higgs vevs 
can again be dropped and we can analyse the edge contributions as before with the result 

N 

- E E'«w ( 6 - 9 ) 

eeA(X) 1=1 

where t e = 1 2 , for each pair of fixed points (fi,f 2 ) connected by the edge e, is the Kahler 
parameter of the line P 1 associated to e. Altogether, the instanton weight is given by 

g i i9 I (tt/ ) e -E eeA (X) E£i*e|A ije | _ (6.10) 

Fluctuation determinants 

The next step in the evaluation of the partition function is to determine the ratio of quantum 
fluctuation determinants. According to our rule of the previous section, we can write down the 
ratio in the noncommutative gauge theory and read off from the integrand the equivariant Euler 
characteristic of the complex (|5.5ip using the techniques of [7]. The ratio at a fixed point / G A (A) 
comes out to be 

X3 f (t)Xd f (-t) 



(l-tl)(l-t 2 )(l-t 3 ) 

as in (|3.41|) , with %j (t) given by (|6.1|) . The character at the fixed point / decomposes as 



(6.11) 



Xf (X) = [W f -{l-t 1 ){l-t2)V l2 j-{l-ti){l-h)V lz j 

- (1 - t 2 ) (1 - t 3 ) V 23J - (1 - h) (1 - t 2 ) (1 - t 3 ) v f ) 



W} - (1 " tl)(1 " t2) VS, - (1 " tlKl " t3) VZ f (6-12) 

(l-t 2 )(l-t 3 ) (l-^)(l-t 2 )(l-t 3 ) \ 1 

* 2 is 23J tifcta ^ (l-ti)(l-t 2 )(l-t 3 ) 
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where the T x 17(1) modules are given by 

N 

w f = ei >f ' 



1=1 

N 



Vf = E^f E *r 1 c 1 ^ 1 ! 

N 

1=1 (i.i)eA 7> i > / 
with (a, /3, 7) a cyclic permutation of (1,2,3). 

The computation of the ratio of determinants from (I6,12|) is now just a tedious but completely 
straightforward algebraic exercise. By using splittings of modules with properties analogous to 
those of Section 15. b\ one easily shows that all contributions independent of the Chan-Paton space 
Wf vanish at (£1,62,63, a) = (0,0,0,0). After dropping the perturbative contribution Wf <8> Wj, 
one thus finds that the only non-vanishing contributions which survive at (ei, £2, £3, a) = (0, 0, 0, 0) 
are given by 

w f ® Vf to) (I - t 3 ) 

— f - -V f ®W* f - K - in 2A 3) V f <g> Vf (6.14) 

ht 2 t 3 1 f t x t 2 t 3 } f 

1 f T/ Wf®Vnj , (l-*i)(l-* 2 ) xr ^ T/ * 
+ -V12J ®Wf — — + — V 12J ® V* 2 f 

1 — *3 \ t\t 2 t\ t 2 

+ ^ (-iw ® - — + — v 13J ® v 13J 

1 ( T/ «W ^/ g ^23,/ , (1 ~ * 2 ) (1 ~ t 3 ) _ 

+ ^ (-ifc,/ ® - — + — v 23J ® y 23i/ 

After applying the transformation (|5.56|) , each of the four lines in (I6.14p gives a minus sign to some 
power. 

The first line of (|6.14|) coincides with the character (|5,57[) computed in Section 15.51 and gives 
a factor (— 1)^ £i=i \ w hf\ for each fixed point / 6 A(X). The remaining terms are a nonabelian 
generalization of the edge character computed in [7] (reproduced formally by setting W to 1), and 
can be understood from the point of view of the matrix quantum mechanics as follows. By T-duality, 
the D6-D2 system corresponds to a four-dimensional instanton problem over each rational curve of 
X. These asymptotics are each described by an ADHM quiver [M], with associated vector spaces 
Wf of dimension N and V a p t of dimension fe 7 f = \Xy A. The full quiver is the modification of the 
D6-D0 quiver of Fig. [1] obtained by inserting the vector spaces V a p f plus all additional open string 
fields [12]. This modifies the complex (|5.5ip by including terms from the four-dimensional ADHM 
deformation complex |34} I40j . The additional contributions in (I6,14p then arise from the usual 
characters in four-dimensions. They may be computed in the present case by carefully matching 
the edge contributions with the partner terms coming from other vertices of the toric diagram 
A(X) as in Section [BTT1 above. 

For example, consider the contribution L23,/ from the last line of (|6.14p . which is oriented in 
the t\ "direction". To this term we have to add its partner term coming from the vertex which 
shares the same edge e, and which has the same two-dimensional partition structure of V 23 / as its 
asymptotic behaviour. Using (16.51) with t\ <-> t 3 the full edge contribution is then 



E 2 3,e = L 23 ,/(*i,t2,*3, ei ,/) + L 23 ,/ (q 1 ,t 2 t™\t 3 t™ 2 ,e hf ) . (6.15) 
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We use the splitting L23J = j + l_ 23 j with 

L ^,/ = ^h; {~ V23J w f + V23J (fU6) 

and (\-23 f)* \t 1 t 2 t =1 = ~ ^23 fit t 2 *3=i' together with the condition (|6.4p . after some algebra one 
finds that the corresponding splitting E^ 3 e in the limit (ei, 62, £3, a) = (0, 0, 0, 0) is given by 

N N 

Y Y Um 1 +km 2 -i)+ J2 Y Y mi ( 6 - 17 ) 

1,1' =1 (j,k)e\i M M'=i (j,k)eX 1M U',k')e\ ltllJ 

N N 

= N Y Y ( mi 0' - 1) + ma (*: - 1) + 1) + IAl/,/1 |A w | m x . 
1=1 (j,k)e\ h ij l,i'=i 

In this way one finds that the final result for the ratio of fluctuation determinants can be expressed 
as (— iy( n f\ where 

N N 
J(7?/) = Yl N YM+ Y N Y Y Ke(i-l)+m 2 ,e(i-l) + l) 

feA(x) 1=1 eeA(x) 1=1 (i,j)e\i, e 

N 

+ Y Y \he\\*l>,e\mi,e (6-18) 
eeA(X) l,l'=l 

generalizes the abelian N = 1 result of IS] ■ 



Partition function 

We can now collect all the ingredients and write down the Donaldson-Thomas partition function on 
any toric Calabi-Yau manifold X in the U(1) N phase of the six-dimensional topological Yang-Mills 
theory on X. One finds 

Z^ r (X) = ^(_i)J(*/) e ^K*f) e -E e£ A(x) E£ilA,, e |t e _ ( 619 ) 

After some rewriting we have 

Z^ )N (X) = Q K * f) (-1) (JV+1)I( ^ [J (-1) E ^' =1 |Al - l|A ".« |mi - e l A '-l* e , (6.20) 

iff eeA(X) 

where the 1 in the N + 1 factor arises from the minus sign in the definition q = —e 1 ^ and 1(7?/) is 
the CI13 contribution to the instanton action given by (|6.7I) . The mi-dependent signs in (I6.20p are 
naturally interpreted as framings of the corresponding edges, as in the topological vertex formalism. 

As a simple example, let us consider the resolved conifold X = X con , the total space of the 
rank two holomorphic bundle Opi(— 1) ® Opi(— 1) — ► P 1 (viewed as the normal bundle to the local 
Calabi-Yau curve P 1 ). In this case one has 

Z U D ? N (X con ) = Y, g E - l(|7r ^ l+|7r ^ l)+E ^ £(,W*W+D 

Tl,/! TJV,/i 

x (_i) (JV+1) ( E '=i <ln,f l \+\n,f a \)+I$Li E( i , 3 - )6 A i (*+i+i)) 



57 



=x l^illVI e -E£Li*l-VI _ (6.21) 



This formula gives 



ZoPVcon) = ((-i^+i^/l+E^^+i+l) (-i)IAI e"'W) W 

= R KT • 6.22 

Up to an alternating sign, this is just the iV-th power of the abelian result which coincides with 
the topological string amplitude computed in the melting crystal reformulation of the topological 
vertex [3J [H] - The alternating sign will be explained in the next section. 



7 Summary and applications 

In this final section we will discuss some properties of the U(1) N partition functions (|6.2U|) . We 
will also discuss some open questions and relations to other models. In particular, we summarize 
our results and describe how they could be applied to other settings. 

7.1 The OS V conjecture 

Let us consider for simplicity the threefold X = C 3 . The partition function (|3.ip can be rewritten 
in the form 

Z VW N (C 3 )= e<> m *-°JXiLi\*i\ = M(q) N , (7.1) 

7ri,...,7TJV 

where M(q) is the MacMahon function (|3.2p of q = e~ 9a and 

g s =g s -NiTT. (7.2) 

The partition function is just a power of the abelian N = 1 result. This is reasonable since the torus 
fixed points of the moduli space (I4.19P essentially broke up accordingly (so that no new non-trivial 
instantons are present). On the other hand, the Donaldson-Thomas string coupling constant g s is 
modified to (|7.2[) as well. As we now explain, this modification is natural from the point of view of 
the OSV conjecture [2]. 

Consider Type IIA string theory on I x I 4 , where D6, D2 and DO branes wrap holomorphic 
cycles of the Calabi-Yau threefold X. The mixed ensemble partition function for BPS bound states 
with fixed chemical potentials <f>2 and <fio for the D2 and DO brane charges, and magnetic charge p° 
of the D6-branes, is denoted Zbh(p°; <$j> 0o)- It factorizes in the limit of large charge p° and small 
string coupling G s as [2] 

Z bh (p°; <%,<h) = |^to P (G s ,t a )| 2 , (7.3) 

where Z top (G s ,t a ) is the A-model topological string partition function on X evaluated at the 
attractor point |44L 14*5] of the moduli space given by 

Airi 47ri , 202 
G s = —- = 5- and t a = ^-r- (7.4) 

with t a the Kahler parameters of the two-cycles wrapped by the D2-branes. 
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If we suppose now that the six-dimensional cohomological gauge theory on X computes the 
topological A-model partition function, then the U(N) generalization means including multiple 
D6-branes from the point of view of the OSV formula (|7.3p . However, the Calabi-Yau crystal 
description is valid in the strong coupling regime [3] and so we expect the relation 

Rewriting the OSV formula (|7.3|) in the S-dual string couplings g s and g s with and without the 
D6-branes, one finds 

ip° 

9s = 9s ~ 17 • (7 ' 6) 

Taking into account the relation p° = we see that the string coupling in the Donaldson-Thomas 
description changes in the way expected from the OSV conjectureO 

According to the generic prediction (|7.3p . the general formula (|6.2U|) should factorize in the 
large N limit. It would be interesting to further check the OSV factorization for our C 3 example. 
Factorization including D6-branes has only been checked for the single example X = K3 x T 2 |46j. 
Furthermore, the conformal field theory derivation of the OSV formula of [47] does not readily 
generalize for multiple D6-branes. Given that the string coupling in our case lives in the strong 
coupling regime, it would be interesting to see if and how the OSV factorization works here. A 
refined version of the OSV formula was found in |48j using the U(l) Donaldson-Thomas theory 
for a D6 brane-antibrane pair on compact Calabi-Yau manifolds. It was also shown there that in 
certain limits of the background one can identify the abelian Donaldson-Thomas partition function 
with the BPS index for stable D6-D2-D0 bound states with unit D6-brane charge. 



7.2 Enumerative invariants 

Let us study the small q expansion of the partition function (|7.1|) . with the aim of understanding 
its role in enumerative geometry. For example, for U(2) gauge group one gets 



(C 3 ) = V (-l) 3 (M+M) 9 M+I**| 

7ri,7T2 

(_1)M + M ^tuI + M 

7ri,7T2 

(E (-«)'"' ) 2 <") 



nc 



71=1 

= 1 - 2q + 7q 2 - 18q 3 + 47q 4 - UOq 5 + 258g 6 - 568g 7 + 1237g 8 + O (q 9 ) . 
Similarly, for the U(N) gauge theory one finds 

Z^ 1)JV (C 3 ) = (-l) (Ar+1)(|7ri|+ '" +|7rjvl) g |7ri1 Tx 

7ri,...,7TjV 



4 The 47r factor is a matter of convention. 

5 The dependence on N does not spoil the S-duality conjecture. In fact, the instanton measure does not depend 
on the Higgs vevs. Nevertheless, it would be interesting to check this prediction against a computation in some 
Chern-Simons theory. 
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7T 



= ( n (i-a-^ff)")"") (7-8) 

n=l 

= 1 _ N g + (1 (_ 1)2 iV ^2 + | ( _ 1)2 iV ^ q 2 

+ (_1 (_1)3JV ^3 _ 5 ( _ 1)3 JV ^2 _ 10 ( _ 1)3 JV ^ g 3 

+ ("1) 47V ^ 4 + | ("1) 47V ^ 3 + W (-!) 4iV ^ + T (-!) 4iV ^) / + O (? 5 ) • 
The numerical invariants computed by the small g-expansion (|7.8p are all integer-valued. 

As the nonabelian U (1) N partition function on C 3 is given by the iV-th power of the MacMahon 
function, up to sign factors, the numerical values of the Donaldson-Thomas invariants are the 
same. But the continuation of the MacMahon function in (|7.1|) to complex values of the string 
coupling suggests a non-trivial interpretation in terms of Gromov-Witten theory. By using the 
correspondence between the Donaldson-Thomas and Gromov-Witten partition functions [7], one 
sees that the Gromov-Witten invariants change non-trivially. This change can be encoded in the 
topological string coupling constant associated with the D6-brane charge. In terms of the usual 
Gromov-Witten theory, this may arise through geometric transition via a connection with Chern- 
Simons gauge theory with complexified coupling constant, as arises for complex gauge groups. It 
would be very interesting to understand the meaning of the new parameter iV in terms of the 
underlying closed topological string theory. 

However, we should reiterate that our computations are only valid in the Coulomb phase, where 
the gauge group is completely broken to its maximal torus U(1) N . Furthermore, we considered 
only the target space X = C 3 properly, wherein the instanton moduli space could be characterized 
by a stable framed representation of the quiver with relations of Fig. [T] in the category of complex 
vector spaces. The precise characterization of the full moduli space and the construction of the 
full nonabelian Donaldson-Thomas theory is a much more difficult task. For a generic threefold 
X it should involve a stable twisted representation of the quiver with relations depicted in Fig. [1] 
(including ADHM quivers over the rational curves) in the abelian category of coherent sheaves of 
Ox-modules [49J, with non-trivial framing. A recent proposal for such a construction in the case 
that X is a local curve can be found in [13] . Understanding of the moduli space of the full nonabelian 
Donaldson-Thomas theory, exploring its combinatorial nature in terms of random partitions, and 
searching for new geometric invariants are all interesting and challenging tasks, which are however 
beyond the scope of the present work. In this paper we have only probed a small corner of the full 
moduli space, and developed some potentially useful starting techniques in this direction. 

7.3 Relations with other models 

It is instructive to compare our results with those obtained on other backgrounds, some of which 
can be related to ours through duality transformations. It was argued in |111 [50] that the fact 
that perturbative A-model topological string amplitudes capture non-perturbative information 
about D-brane bound states can be understood as a consequence of S-duality, when embedding 
the topological string theory into the physical Type IIB superstring theory. This S-duality was 
used in [51] to relate the abelian Donaldson-Thomas invariants on a Type IIA compactification 
with the Gopakumar-Vafa BPS invariants of M2-branes in M-theory, establishing another point of 
view on the relationship between four and five dimensional black holes of [52] . One can start with 
a Type IIA compactification on a ten-dimensional background given by the product of a Calabi- 
Yau threefold and the four-dimensional space E 3 x S 1 . Then the charge one D6-brane background 
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can be transformed into a charge one Taub-NUT geometry by applying a T ST duality transfor- 
mation, where the D2 and DO branes become respectively fundamental strings and Kaluza-Klein 
momentum modes along the S 1 of the Taub-NUT geometry. More precisely, after a T-duality 
transformation along the S 1 of the space K 3 x S 1 , the Type IIA D6-brane gets mapped into the 
Type IIB D5-brane. S-duality of the physical Type IIB string theory transforms this D5-brane into 
an NS5-brane, and finally after the last T-duality transformation one arrives at the Taub-NUT 
geometry. This configuration can then be lifted to M-theory. See |51| for further details. 

It is reasonable to expect that this set of dualities continues to hold for the nonabelian D6- 
brane configuration, though more work would need to be done at the supergravity level to establish 
this. However, if this is the case then it is interesting to speculate that our computation predicts 
a relation between topological A-model amplitudes on the Taub-NUT geometry and the partition 
function of N Type IIB NS5-branes, as a consequence of S-duality. It was pointed out in [5D] that 
a "mirror" version of this duality is already implied in [53], where it was argued that B-model 
amplitudes compute the partition function of N Type IIA NS5-branes. In the setup of [53J one 
starts with ./V NS5-branes on a Calabi-Yau threefold X and relates this configuration through T- 
duality with Type IIB string theory on X x M 4 , where M 4 is a Taub-NUT space (or better an ALE 
space of type Aff—i when we let the size of the compactified circle grow to infinity). In concrete 
computations they take X = K3 x T 2 and its Z2 orbifold. 

By a supergravity analysis and careful matching of F-terms on both sides, one can compute the 
nonperturbative contribution to the partition function of iV well- separated NS5-branes, which turns 
out to be equal to the (N— l)-th power of the B-model topological string amplitude^ Reversing the 
statement, one may say that perturbative topological string amplitudes only compute the partition 
function of NS5-branes in the Coulomb branch. Thus even though it is not completely clear how 
to explicitly translate this set of dualities to our setup, our results are compatible with the findings 

of [53]. 

A similar picture arises in [H] where a one-parameter generalization of topological string theory 
was proposed. Although it seems natural following the reasonings of [M] to identify this parameter 
with the rank N of the nonabelian Donaldson-Thomas theory, it is not clear to us how to make 
precise contact with their proposal. Other multiparameter extensions of topological string theory 
are found in |55j and [56]. It would also be interesting to compare our results with the U(N) 
extension of the construction of [57] which considered the equivariant reduction to lower dimension 
of the six-dimensional gauge theory on a local surface. 
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